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@ Image processing method and apparatus. 

(57) When image data is compressed in units of 
blocks, if a compressed data amount D 
obtained by reversibly compressing a block, 
and a predetermined value L satisfy D ^ L, the 
block is reversibly compressed ; if they satisfy D 
> L, the block is irreversibly compressed, so 
that computer-created image data is compres- 
sed while preventing deterioration of image 
quality, and a gradation image or a natural 
image is efficiently compressed. When a pixel of 
interest has the same value as color data (C t ) of 
the immediately preceding pixel, the shortest 
code , 1 I is output; when the pixel of interest 
has the same value as color data (C 2 ) of a pixel, 
which has color data different from C 1( and 
appears latest, the second shortest code '0V is 
output; when the pixel of interest has the same 
value as color data (C 3 ) of a pixel, which has 
color data different from and C* and appears 
latest, the third shortest code '001 ' is output; 
when the pixel of interest has color data diffe- 
rent from C 1f C 2 , and C 3 , an unused code '000' is 
output, and the color data at that time is output 
Thus, a computer-created image is compressed 
at a high compression ratio without causing 
deterioration of image quality. 
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BACKGROUND OF THE INVENTION 
[Field of the Invention] 

The present invention relates to an image processing method and apparatus and. more particularly to an 

Sr^!t S '° h n , meth ° d aPParatUS f ° r ""Wna "™ge b V switching a compression method 
between a reversible compression method and an irreversible compression method in accordance with the 

ZT'J"?- 8 T^" m8th ° d and apparatUS for expandi " 9 data inc,udi "9 both reversibly com- 
pressed data and irreversibly compressed data. y 

[Description of the Related Art] 

In recent years, with spread of, e.g.. DTP, images to be created on computers are required to have hioh 
image quality, and tend to have a large number of colors and gradation levels 9 
-j The i'S r " 1at, ° n amouht an ima 9e of this type is as large as about 46 Mbytes in the case of e a an 
E^TS t P,> 256 9radat, ° n ,eVe,S ' 8nd three Primary CO,ore - The informati °" amount cante dete^sed ! 
•PD?- hetinX.TfH- " ""l * 3 ^ deSCTiptton ,an 9 ua 9 e < to be abbreviaTed to as 
Iriiw h f T nafte ?- ,n tn,s eaB8 ' however . development from code information to image data requires a long 

lYnaae dataT F^t h^" 9 ' d3t3 navin9 a sma,ler information amount cannot be generated from developed 

image data For this reason, the compression technique of image data is important 

form) method recommended by the JPEG (Joint Photographic Experts Group) is known The ADCTImaoecorrt 
presslon method will be described below. 9 
Fig. 14 is a block diagram showing an arrangement of an ADCT image compression apparatus 
Referring to Fig. 14, reference numeral 3101 denotes a color conversion section for convertino an RGB 

th. r^ZT e ?- ""TlH™ 2 den ° teS 3 80,5 SampHn9 SeCtion for decreasing color difference data by utilizing 
the charactenstics-that human eyes are sensitive to luminance but insensitive to color differences More ^ 

ZX:Z C Z^^ ^ 3Vera9e ^ " tW ° — ce data 

Hon SSSTlSr 18 ;! 03 de T S 8 , DCT SeCti ° n f ° r dividh19 ima9e data output from the sub ^mpling sec- 
£^ T f aC ^ C °; S /,f " 9 ° f 8 X 8 Pixe,s ' which b,ocks form a matrix in the horizontal and vertical 
d,rect,ons, and executing DCT (Discrete Cosine Transform) to convert the blocks into frequency space date 
Reference numeral 3104 denotes a quantization section for dividing 8 x 8 = 64 DCT coeff loSTSJS 
fvely with quantization values having different step widths to convert tnem into quantization dSa 

r^fn? ™T 5 den ° teS 3 Hufftna " enCOdi " 9 Section for Ossifying 64 quantized DCT coeffi- 

t^rT °Z qua " tization sectio " 3104 •* °ne DC coeff icient and 64 AC coefficients , and e^cSil 
^ hi f' n aC «" rdance 3 Huffman table recommended by the JPEG. The encoded data aTato- 
sIphI ! ,nforma I° n SUCh as quantization table data, Huffman tabie data, and the like, and ie then 
stored in a memory or transmitted to another apparatus 

pf; 15 b 8 "J 5 * d j agram snowina a" arrangement of an ADCT data expansion apparatus. 

cod^^Cuanierdra^ ^ den ° teS 3 . ^ d ~° di " 9 - 

the HurZnT" H 6ral ^ d «° teS a " inVGrSe c > uanbzation action for converting quantized data outputfrom 
the Huffman decoding section 3205 into DCT coefficient data. The inverse quantization is achieved bv muItT 
plymg 64 coefficients with the corresponding quantization values using the qLtizatirtabirusXoLuar 
tization in the quantization section 3104 in Fig. 14 o»""»oniaDieuseauponquan- 

ria n r era ' 3203 den ° teS 30 inV6rSe DCT section for executing inverse DCT of DCT coefficient 

data output from the inverse quantization section 3204 to convert them into actual image data 

th. ;! T "T era 02 den ° teS a " inter P°'a«on section for interpolating Cr and Cb data omitted from 

of Cr and Cb data occurs when data .s compressed by the sub sampling section 3102 in Fig 14 

Reference numeral 3201 denotes a color conversion section for converting YCrCb color space data outn„t 
from the intention section 3202 into NTSC-RGB cotor space data or color S %^^ 

data T asTe?amp.e "°" ^ ^ COmpression apparatus .wfll be described below by taking actual - 
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Fig. 16 shows NTSC-RGB color space data as a portion of color multi-value image data created by a com- 
puter, i.e., a portion (16x16 pixels) of image data in which a character portion of a color multi-value image is 
developed. 

Referring to Fig. 16, reference numeral 3301 denotes R data; 3302, G data; and 3303, B data. Note that 
each pixel has a data range of 8 bits (0 to 255), and in Fig. 16, a portion of a character in blue expressed by 
(R, G, B) = (30, 30, 225) is drawn on a relatively dark white background expressed by (R f G, B) - (225, 225, 
225). 

The color conversion section 3101 executes conversion from an NTSC-RGB color space into a YCrCb color 
space using the following equations: 

Y = 0.299 xR + 0.587 xG + 0.114 x B 
Cr = 0.71 3(R - Y) 
Cb = 0.564(B - Y) 

Furthermore, in order to allow overshoot and undershoot in calculations in the YCrCb color space accord- 
ing to the CCIR recommendation, the section 3101 rounds the data using the following equations: 

Y = 219.0 xY + 16.5 
Cr = 224.0 xCr + 128.5 
Cb = 224.0 xCb + 128.5 
The sub sampling section 3102 performs sub sampling of Crand Cb data, obtained by the above-mentioned 
equations. As a sub sampling method, a simple thinning method, a MAX data selection method, a MIN data 
selection method, and the like are known. In this case, an average value method is used. More specifically, 
with the average value method, an average value of two adjacent pixel data is used as one data. 

Fig. 17 shows the processing results of the image data shown in Fig. 16 by the color conversion section 
3101 and the sub sampling section 3102. Referring to Fig. 17, reference numeral 3401 denotes Y data; 3402, 
Cr data; and 3403, Cb data. The data amounts of the Cr and Cb data are reduced to 1/2 by the sub sampling 

processing. , ^ jf ; 

The Y, Cr, and Cb data shown in Fig. 17 are input to the DCT section 31 03. The DCT section 3103 divides 
the input data into 8 x 8 data blocks forming a matrix in the horizontal and vertical directions. As a result of 
block division, the Y data 3401 is divided into four blocks 3401a to 3401d, as shown in Fig. 17. Similarly, the 
Cr data 3402 is divided into two blocks 3402a and 3402b, and the Cb data 3403 is divided into two blocks 3403a 
and 3403b. Subsequently, the DCT section 3103 executes DCT for these eight blocks. 

Fig. 18 shows the DCT result of the eight blocks shown in Fig. 17. 

Referring to Fig. 18, reference numeral 3501 denotes DCT coefficients of the Y data. Blocks 3501a to 
3501d respectively correspond to blocks 3401a to 3401d shown in Fig. 17. Similarly, reference numeral 3502 
denotes DCT coefficients of the Cr data; and 3503, DCT coefficients of the Cb data. Note that each block after 
DCT consists of one DC component at the upper left corner, and remaining 63 AC components. 

The DCT coefficient data 3501 to 3503 shown in Fig. 18 are quantized by the quantization section 3104. 
In this case, quantization is performed based on quantization tables recommended by the JPEG. 

Fig. 19 shows quantization tables used in quantization. Referring to Fig. 19, reference numeral 4001 de- 
notes a quantization table for Y components; and 4002, a quantization table for Cr and Cb components. 

Fig. 20 shows the quantization result of DCT coefficient data shown in Fig. 1 8 using the quantization tables 
shown in Fig. 19. Referring to Fig. 20, reference numeral 3601 denotes quantized data of the Y components; 
3602, quantized data of the Cr components; and 3603, quantized data of the Cb components. 

The encoding section 3105 classifies the quantized data 3601 to 3603 shown in Fig. 20 into DC and AC 
components. As for the DC components, the section 3105 forms an optimal Huffman encoding table on the 
basis of a histogram of a difference from a DC component of the previous block, and performs encoding ac- 
cording to the table. As for the AC components, the section 3105 sorts the AC components in a zigzag order 
shown in Fig. 21, forms an optimal Huffman encoding table on the basis of a histogram of a combination of a 
run length of coefficients 0 (the number of coefficients 0 until a coefficient x other than 0 appears), and the 
value x, and performs encoding according to the table. 

Since each pixel has a range of 8 bits, original 16 x16 pixel data in the NTSC-RGB color space, which 
has a data amount of 6,144 bits (= 16 x 16 x three colors x 8 bits), is compressed to 795 bits when the data is 
output from the encoding section 3105. Therefore, image data is compressed to about 1/7 .7 (6,144/795 * 7.7). 
However, in practice, since image size data, quantization table data, encoding table data, and the like are added 
to the data encoded by the encoding section 3105, the compression ratio is slightly lowered. 

The processing flow of the ADCT data expansion apparatus will be described below. 

The Huffman decoding section 3205 decodes input encoded data. 

The inverse quantization section 3204 multiplies quantized data output from the Huffman decoding section 
3205 with the coefficients of the quantization tables shown in Fig. 19, thereby executing inverse quantization. 
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With the above-mentioned processing, data shown in Fig. 22 are obtained. Fig. 22 shows the result of Huff- 
man decoding and inverse quantization of the ADCT-compressed image data. Reference numeral 3701 de- 
notes Y components; 3702, Cr components; and 3703, Cb components. 

As can be seen from a comparison between the inverse-quantized data (DCT coefficient data) shown in 
Fig. 22 and the DCT coefficient data before quantization shown in Fig. 18, these two data are apparently dif- 
ferent from each other. 

Subsequently, the inverse DCT section 3203 executes inverse DCT of the DCT coefficient data output 
from the inverse quantization section 3204 to reconvert them into Y, Cr, and Cb data. Fig. 23 shows the inverse 
DCT result of the DCT coefficient data shown in Fig. 22 by the inverse DCT section 3203. Reference numeral 
3801 denotes Y data; 3802, Cr data; and 3803, Cb data. 

The interpolation section 3202 interpolates data omitted from the image data output from the inverse DCT 
section 3203, and the color conversion section 3201 converts the YCrCb color space data output from the in- 
terpolation section 3202 into NTSC-RGB color space data. 

Fig. 24 shows data finally obtained by the ADCT data expansion apparatus. Reference numeral 3901 de- 
notes R data; 3902, G data; and 3903, B data. 

However, the above-mentioned technique suffers from the following problems. 

More specifically, the ADCT image compression method is an irreversible compression method which los- 
es data upon sub sampling and quantization. Therefore, as can be apparent from a comparison between NTSC- 
RGB color space data (Fig. 16) before compression, and NTSC-RGB space data (Fig. 24) as a result of com- 
pression and expansion of the data of Fig. 16, data expanded by the ADCT image compression method be- 
comes different from data before compression. In other words, image quality deteriorates. - 

The merits of an image created on a computer (computer-created image) are a smooth outline, noise-free 
colorpainting based on a single color perfigure (or character), and the like. However, when image data is com- 
pressed and expanded by the ADCT image compression method, a non-smooth outline of a figure, pseudo 
edge called mosquito noise, coloring due to quantization, and the like occur, and the merits of the computer- 
created image cannot be fully exhibited. Especially, since the above-mentioned compression method performs 
8x8 block processing, a considerable change in color occurs at the boundary areas of the blocks. 

When the compression ratio is to be increased in the ADCT image compression method, the AC compo- 
nents of the DCT coefficients are finally lost, and a block distortion is generated. In the extreme case, the re- 
solution may deteriorate to, e.g., 1/8. 

For this reason, compression may be performed while suppressing quantization so as not to cause con- 
spicuous deterioration of image quality. However, such a technique is not practical in terms of the compression 
ratio since a computer-created image is originally characterized by many high-frequency data. Therefore, a 
computer-created image such as an image created by DTP need be compressed by a reversible method ca- 
pable of obtaining a high compression ratio. 

As a compression method for a color multi-value image created by a computer, methods shown in Fiqs 
25 and 26 are known. 

In the compression method shown in Fig. 25, a run length identification circuit 4012 identifies the run 
length of pixel data having the same color, and an encoding section 4013 encodes and transmits the run length 
of the color and pixel data at that time. That is, the concept of a so-called MH encoding method is extended 
to color image encoding. 

In the compression method shown in Fig. 26, a line memory 4 102 for storing previous line data is arranged 
a run length identification circuit 4103 identifies the run length of pixel data having the same color and an 
encoding section 4104 encodes and transmits the run length of the color and pixel data at that time with ref- 
erence to previous line information. That is. the concept of a so-called MR encoding method is extended to 
color image encoding. 

Each of the above-mentioned methods can obtain a very high compression ratio when pixel data having 
the same value continuously appear for a long period of time. However, these methods are not suitable for an 
image including fine patterns such as a DTP image. Also, since the encoding section often uses Huffman en- 
coding, and the like, the circuit is complicated. In addition, since the run length identification circuit is required 
encoding cannot be started until the run length ends, thus disturbing real-time processing. 

Furthermore, the compression method shown in Fig, 26 aims at a higher compression ratio than the com- 
pression ratio shown in Fig. 25 by utilizing two-dimensional correlation of an image. .However, the method 
shown in Fig. 26 must have a pixel data memory for at least one line. 

In a method of compressing image data by a reversible compression method such as Huffman encoding 
the data amount changes after compression. In particular, when a gradation image or a natural image read by 
an image scanner is reversibly compressed, the compressed data may often have an extremely large data 
amount. For this reason, a large-capacity image memory for the worst case must be prepared. 



_0583107A2J.> 



EP 0 583 107 A2 



SUMMARY OF THE INVENTION 

The present invention has been made to solve the problems of the above-mentioned techniques, and has 
as its object to provide an image processing method and apparatus, which can compress multi-value image 
5 data at a high compression ratio, and an image processing method and apparatus for expanding compressed 
data to reproduce the multi-value image data. 

In order to achieve the above object, the present invention comprises the following arrangement. 
That is, there is provided an image processing apparatus for processing image data in units of blocks each 
consisting of a plurality of pixels, comprising: reversible compression means for reversibly compressing a block 
10 which satisfies D s L (D is the compressed data amount obtained when the block is reversibly compressed, 
and L is a predetermined value); and irreversible compression means for irreversibly compressing a block 

which satisfies D > L ■■„.■■ 

Preferably, the reversible compression means comprises: sorting means for one-dimensionally sorting pix- 
el data of the block; latch means for latching the pixel data output from the sorting means; first comparison 
is means for comparing first pixel data latched by the latch means with second pixel data outputfrom the sorting 
means after the first pixel data, and outputting a first comparison result; second comparison means for com- 
paring pixel data held in advance in at least one holding means with the second pixel data, and outputting at 
least one second comparison result; updating means for. when the first comparison result indicates a non-co- 
incidence and the second comparison result indicates a coincidence, updating pixel data in the holding means 
20 which holds the pixel data coinciding with the second pixel data to the pixel data latched by the latch means, 
and for when both the first and second comparison results indicate a non-coincidence, updating pixel data in 
the holding means which holds the oldest pixel data to the pixel data latched by the latch means; and output 
means for when the first comparison result Indicates a coincidence, outputting the first companson result, for. 
when the first comparison result indicates a non-coincidence, and the second comparison result indicates a 
25 coincidence, outputting the first comparison result, and the second comparison result in an order named^and 
for, when both the first and second comparison results indicate a non-coincidence, outputting the first com- 
parison result, the second comparison result, and the second pixel data in an order named. 

More preferably, the reversible compression means further comprises: calculation means for calculating 
the compressed data amount D on the basis of the first and second comparison results; discrimination means 
30 for discriminating a relationship between the compressed data amount D obtained by the calculate means 
and the limit value L; and recovery means for, when a discrimination result of the discrimination means indicates 
D > L, restoring the pixel data latched by the latch means and pixel data held in the holding means to values 
before the beginning of processing of a present block. 

There is also provided an image processing method for expanding compressed data obtained by com- 
as pressing image data in units of blocks each consisting of a plurality of pixels, comprising the steps of: expanding 
the compressed data by selecting one of reversible expansion processing and irreversible expansion process- 
ing on the basis of information indicating a compression method of the compressed data; and reproducing orig- 
inal image data by synthesizing image data expanded by the reversible expansion processing and image data 
expanded by the irreversible expansion processing. 
40 Preferably the reversible expansion processing includes: the first input step of inputting a first bit corre- 

sponding to a pixel of the compressed data; the second input step of inputting compression information con- 
sisting of at least 1 bit of a second bit and the following bits corresponding to the pixel when the first bit is "T; 
the exchange step of exchanging pixel data latched by latch means with pixel data held in at least one holding 
means corresponding to a predetermined value when the compression information has the predetermined val- 
45 ue- the updating step of updating the pixel data held by the holding means to the pixel data latched by the 
latch means, and thereafter, updating pixel data to be latched by the latch means to pixel data following the 
compression information when the compression information is different from the predetermined value: and the 
output step of outputting pixel data latched by the latch means. 

There is also provided an image processing method for reversibly compressing image data, comprising: 
50 the latch step of latching input pixel data; the first comparison step of comparing first pixel data latched in the 
latch step with second pixel data input after the first pixel data, and outputting a first companson result; the 
second comparison step of comparing at least two different first and second holding data, which are held in 
advance with the second pixel data, and outputting a second comparison result; the updating step of updating 
the first holding data to the first pixel data when the second comparison result indicates a coincidence between 
55 the first holding data and the second pixel data, and of updating the second holding data to the first holding 
data and thereafter, updating the first holding data to the first pixel data when the second companson result 
indicates a coincidence between the second holding data and the second pixel data or when both the first 
and second comparison results indicate a non-coincidence; and the output step of outputting a first code when 
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the first comparison result indicates a coincidence, of outputting a second code when the second comparison 
result indicates a coincidence between the first holding data and the second pixel data, of outputting a third 
code when the second comparison result indicates a coincidence between the second holding data and the 
second pixel data, and of outputting a . fourth code and the second pixel data in an order named when both 
5 the comparison results indicate a non-coincidence. 

There is also provided an image processing apparatus for reproducing image data by expanding reversibly 
compressed data, comprising: holding means for holding in advance at least three different pixel data; storage 
means for storing a priority order of the pixel data held by the holding means; outputting means for outputting 
one of the pixel data stored in the holding means or pixel data included in the reversibly compressed data in 

10 accordance with the priority order and 3-bit data of first to third bits of the input reversibly compressed data; 
and updating means for updating the pixel data held by the holding means and the priority order in accordance 
with the priority order and the 3-bit data. 

There is also provided an image processing apparatus for processing image data including pixel type in- 
formation in units of blocks each consisting of m x n pixels, comprising: analysis means for outputting first block 

15 information according to first pixel type information and second block information according to second pixel 
type information in units of blocks; replacing means for replacing a pixel having the first pixel type information 
with first pixel data, and replacing a pixel having the second pixel type information and the same value as the 
first pixel data with second pixel data; reversible compression means for reversibly compressing the pixel data 
replaced by the replacing means in accordance with the first block information and the second block informa- 

20 tion, and outputting reversibly compressed data and an area discrimination result; interpolation means for in- 
terpolating pixels according to the pixel type information and the area discrimination result to pixel data ac- 
cording to other pixels in a block; irreversible compression means for irreversibly compressing the block in- 
terpolated by the interpolation means in accordance with the first block information and the area discrimination 
result; block information output means for outputting third block information in accordance with the second 

25 block information and the area discrimination result; and holding means for holding the reversibly compressed 
data output from the reversible compression means, and outputting the reversibly compressed data in accor- 
dance with the third block information. 

Preferably, the first pixel type information indicates a natural image pixel, and the second pixel type in- 
formation indicates a pixel other than a natural image. 

30 More preferably, when the first block information and the second block information indicate a block con- 

sisting of only pixels other than a natural image, the reversible compression means calculates a compressed 
data amount D to be obtained upon reversible compression of the block, and outputs an area discrimination 
result indicating a first area and reversibly compressed data if D ^ L (limit value), or outputs only an area dis- 
crimination result indicating a second area if D = m x n or D > L; when the first block information and the second 

35 block information indicate a block including both natural image pixels and pixels other than the natural image, 
the reversible compreission means calculates the compressed data amount D to be obtained upon reversible 
compression of the block, and outputs an area discrimination result indicating the first area and reversibly com- 
pressed data if D ^ L, or outputs only an area discrimination result indicating the second area if D > L; and 
when the first block information and the second block information indicate a block consisting of only natural 

40 image pixels, the reversible compression means outputs only an area discrimination result indicating the sec- 
ond area. 

There is also provided an image processing apparatus for expanding compressed data obtained by com- 
pressing image data in units of blocks each consisting of m x n pixels, comprising: irreversible expansion means 
for irreversibly expanding the compressed data; reversible expansion means for reversibly expanding the com- 

45 pressed data, and outputting pixel data and pixel type information; and selection means for selecting one of 
the output from the reversible expansion means and the output from the irreversible expansion means in ac- 
cordance with method information indicating a compression method in units of blocks, and the pixel type in- 
formation, wherein original image data is reproduced by synthesizing the pixel data expanded by the reversible 
expansion means and image data expanded by the irreversible expansion means. 

so Preferably, the reversible expansion means comprises: a latch unit for latching predetermined pixel data; 

a holding unit for holding in advance at least three different holding data; a storage unit for storing updating 
information of the holding data held by the holding unit; an updating unit for, when 1-bit data of a first bit of 
the compressed data is '1', and 2-bit data of second and third bits is other than '11\ exchanging the pixel data 
latched by the latch unit with holding data corresponding to the 2-bit data, and for, when the 1-bit data is T, 

~>5 and the 2-bit data is ' 1.1', updating holding data indicated by the updating information to the pixel data latched 
by the latch unit, and thereafter updating the pixel data latched by the latch unit to pixel data of a fourth bit 
and the following bits of the compressed data; and an output unit for outputting area information accordance 
with 3-bit data of the first to third bits of the compressed data, and outputting the pixel data latched by the 

6 
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latch unit ^ , . 

With the above arrangement, there can be provided an image processing method and apparatus, wherein 
when the compressed data amount D obtained when a block is reversibly compressed and the limit value L 
satisfy D siL the block is reversibly compressedrwhen they satisfy D > U the block is irreversibly compressed, 
and original image data is reproduced by selecting one of a result obtained by expanding compressed data as 
reversibly compressed data and a result obtained by expanding the compressed data as irreversibly com- 
pressed data For example, computer-created image data is reversibly compressed as much as possible to 
prevent deterioration of image quality. On the other hand, image data such as a gradation image, a natural 
image, and the like, for which a sufficient compression ratio cannot be expected by reversible compression, 
is efficiently compressed by irreversible compression, thus preventing shortage of a memory. 

More specifically, most of natural images including various image data are image data for which a high 
compression ratio cannot be expected by the reversible compression method, and hence, area separation be- 
tween a computer-created image and a natural image can be achieved with a very high possibility by discrim- 
inating the relationship between the compressed data amount D and the limit value L. Even when data of a 
natural image are varied by ADCT compression, human eyes cannot often perceive deterioration of image qual- 
ity of such natural image. Thus, the present invention can realize compression with high image quality and a 
constant compression ratio. 

Other features and advantages of the present invention will be apparent from the following description tak- 
en in conjunction with the accompanying drawings, in which like reference characters designate the same or 
20 similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing an arrangement of an image compression apparatus according .to the 
25 first embodiment of the present invention; -f; ^ r 

Fig. 2 is a block diagram showing an arrangement of a reversible compression section shown in Fig. 1; 
Fig. 3 is a block diagram showing an arrangement of an area discrimination unit shown in Fig. 2; 
Fig 4 is a block diagram showing an ADCT compression section shown in Fig. 1; 

Fig. 5 is a block diagram showing another arrangement of the reversible compression section shown in 

30 Fig! 6 is a flow chart showing a reversible compression sequence according to the second embodiment 

of the present invention; 

Fig. 7 is a flow chart showing a sequence of reversible compression processing shown in Fig. 6; 
Fig. 8 is a flow chart showing a sequence of area 2 processing shown in Fig. 7; 
35 Fig. 9 is a view showing a processing order of pixels of the second embodiment; 

Fig. 10 is a block diagram showing an arrangement of a data expansion apparatus according to the third 
embodiment of the present invention; 

Fig. 1 1 is a flow chart showinga processing sequence for realizing a reversibly compressed data expansion 

section shown in Fig. 10 in a software manner; 
40 Fig. 12 is a flow chart showing a sequence of reversible expansion processing shown in Fig. 11; 

Figs. 13Aand 13B are charts for explaining a difference between a flag system and a trigger system; 

Fig. 14 is a block diagram showing an arrangement of an ADCT image compression apparatus; 

Fig. 15 is a block diagram showing an arrangement of an ADCT data expansion apparatus; 

Fig 16 is a view showing a portion of image data of a color multi-value image created by a computer; 
45 Fig. 17 is a view showing a processing result of the image data shown in Fig. 16 by the apparatus shown 

in Fig. 14; . _ 

Fig. 18 is a view showing a DCT- transformed result of eight blocks shown in Fig. 17; 
Fig. 19 shows quantization tables; 

Fig. 20 is a view showing a quantized result of DCT coefficient data shown in Fig. 1 8 using the quantization 
so tables shown in Fig. 19;. 

Fig 21 is a view showing a state of sorting pixel data in a zigzag order; 

Fig. 22 is a view showing a result of Huffman decoding and inverse quantization of ADCT-com pressed im- 
age data; , 
Fig. 23 is a view showing an inverse DCT result of DCT coefficient data shown in Fig. 22; 
55 Fig 24 is a view showing data finally obtained by the apparatus shown in Fig. 15; 

Figs. 25 and 26 are diagrams showing compression methods for a color multi-value image created by a 
computer; 

Figs. 27A and 27B are views showing typical computer-created images; 
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Fig. 28 is a block diagram showing an arrangement of a data compression apparatus according to the 
fourth embodiment of the present invention; 

Fig. 29 is a flow chart showing an encoding processing sequence of a control section shown in Fig. 28; 
Fig. 30A is a view showing an example of pixel data generated by a pixel data generation section shown 
in Fig. 28; 

Fig. 30B is a view showing changes of data to be held in each FF section shown in Fig. 28; 
Fig. 31 is a timing chart of the signals shown in Fig. 28; 

Fig. 32 is a view for explaining a compressed result according to the fourth embodiment; 
Fig. 33 is a block diagram showing an arrangement of a data expansion apparatus for decoding encoded 
data output from the data compression apparatus shown in Fig. 28; 
Fig. 34 is a table showing the processing content of a PLD shown in Fig. 33; 
Fig. 35 is a flow chart showing decoding processing of the PLD shown in Fig. 33; 
Figs. 36A, 36B, and 36C are views showing a decoding state according to the fourth embodiment; 
Fig. 37 is a block diagram showing an image data compression apparatus according to the fifth embodi- 
ment of the present invention; 

Figs. 38A, 38B, and 38C are views showing the relationship among signals 1b\ le, and 1f shown in Fiq 

37; 

Fig. 39 is a detailed block diagram of a pixel data replacing section shown in Fig. 37; 

Fig. 40 is a detailed block diagram of a reversible compression section shown in Fig. 37; 

Fig. 41 is a view showing a sorting order of an image data sorting unit shown in Fig. 40;' 

Fig. 42 is a detailed block diagram of an area discrimination unit shown in Fig. 40; 

Fig. 43A and 43B are flow charts showing a compression processing sequence of the data compression 

apparatus shown in Fig. 37; 

Figs. 44 and 45 are flow charts showing details of steps S47 and S56 in Fig. 43; 

Fig. 46 is a block diagram showing an image data expansion apparatus according to the fifth embodiment; 
Fig. 47 is a flow chart showing an expansion processing sequence of the data expansion apparatus shown 
in Fig; 46; 

Fig. 48 is a flow chart of a reversible expansion section (step S1404 in Fig. 47) of Fig. 46; 

Fig. 49 is a block diagram showing a detailed arrangement of an ADCT 14 shown in Fig. 37; 

Fig. 50 is a schematic block diagram for explaining an adaptive Huffman encoding unit shown in Fig. 49; 

Fig. 51 is a view showing a state of data to be stored in a buffer memory shown in Fig. 50; 

Fig. 52 shows the content of a threshold value table shown in Fig. 50; 

Fig. 53 is a view showing a segment format of a compression memory shown in Fig. 49; 

Fig. 54 is a view showing a format of a segment information table shown in Fig: 49; 

Fig. 55 is a flow chart showing encoded data storage processing in compression processing; 

Fig. 56 is a view showing a sorting order of pixel data different from that shown in Fig. 41 in trie reversible 

compression section shown in Fig. 37; 

Fig. 57 is a block diagram showing an arrangement of an adaptive Huffman encoding unit according to 
the sixth embodiment of the present invention; 

Fig. 58 is a view showing a state of data to be stored in a buffer memory shown in Fig. 57; 

Fig. 59 is a block diagram showing an arrangement of an adaptive Huffman encoding unit according to 

the seventh embodiment of the present invention; and 

Fig. 60 shows the content of an index table shown in Fig. 59. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

An image processing method and apparatus according to an embodiment of the present invention will be 
described in detail hereinafter with reference to the accompanying drawings. 

In the following description, an irreversible compression section adopts an ADCT, a block sizeof 8 x 8 pixels 
is used, and pixel data is defined by 24 bits. However, the present invention is not limited to these In the fol- 
lowing description, NTSC-RGB 24-bit data is used as original image data. However, the present invention is 
not limited to this. For example, original image data may be CMYK data, XYZ data, CIE-Lab data, CIE-Luv data 
or YCrCb data, and data may be defined by either 1 6 bits or 36 bits. Furthermore, in the following description' 
area r indicates an area for reversibly compressing blocks, and "area T indicates an area for irreversibly 
compressing blocks. 3 
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[Fjrst Embodiment] 

Fig. 1 is a block diagram showing an arrangement of an image compression apparatus according to the 
first embodiment. 

5 Referring to Fig. 1, reference numeral 1 denotes an image data holding section for outputting data having 

an NTSC-RGB format and defined by 24 bits/pixel in units of blocks. 

Reference numeral 2 denotes a delay section for holding a block output from the image data holding section 
1 to delay the block by a time corresponding to one block so as to determine execution/non-execution of ADCT 
compression depending on a reversible compression result 

w Reference numeral 3 denotes a reversible compression section for performing reversible compression of 

a block output from the image data holding section 1, and area discrimination of the block, and outputting com- 
pressed data, and a signal S2g indicating an area discrimination result. Further details of the section 3 will be 
described later. 

Reference numeral 4 denotes an ADCT compression section for, when the area discrimination result from 
15 the reversible compression section 3 indicates "area 2", ADCT-com pressing data input from the delay section 
2, and outputting compressed data while dividing them into DC components, low-frequency components, rel- 
atively high-frequency components, high-frequency components, and the like. Further details of the section 4 
will be described later. 

Reference numeral 5 denotes a buffer for storing compressed data output from the reversible compression 
20 section 3. When the area discrimination result from the reversible compression section 3 indicates "area 1", 
the buffer 5 outputs the stored compressed data. 

Reference numeral 6 denotes a segment controller for storing compressed data from the buffer 5 and com- 
pressed data from the ADCT compression section 4 in a first storage section 8. If the first storage section 8 
becomes full of data during compression processing, the segment controtler6 overwrites new compressed data 
25 at addresses where ADCT-compressed data having a lower importance and corresponding to higherfrequency 
components are stored with reference to a segment information table 7, thereby preventing overflow of com- 
pressed data. Note that the segment information table 7 stores the storage addresses of data stored in the 
first storage section 8 by the segment controller 6. 

Reference numeral 9 denotes a second storage section for storing the signal S2g indicating the area dis- 
30 crimination result output from the reversible compression section 3. 

Reference numeral 10 denotes a control section for controlling, e.g., the operation timings of the above- 
mentioned arrangement of this embodiment. 

With the above-mentioned arrangement, the first storage section 8 shown in Fig. 1 stores the divided 
ADCT-compressed data or reversibly compressed data in accordance with the signal S2g indicating the area 
35 discrimination result output from the reversible compression section 3. 

Fig. 2 is a block diagram showing the detailed arrangement of the reversible compression section 3. 

Referring to Fig. 2, reference numeral 201 denotes a sorting unit for serially sorting pixel data of an input 
block. 

Reference numeral 202 denotes a first latch unit for latching pixel data (24 bits) from the sorting unit 201 . 

40 Reference numerals 203 to 205 denote second to fourth latch units for respectively latching pixel data output 
from the first latch unit 202. 

Reference numeral 206 denotes a first comparison unit for comparing pixel data output from the sorting 
unit 201 and pixel data latched in the first latch unit 202, and outputting a 1-bit signal S2a which is *0' when 
the two pixel data are equal to each other, or is .T when the two pixel data are different from each other. More 

45 specifically, the signal S2a indicates whether or not a color represented by pixel data serially output from the 
sorting unit 201 changes, and is T when the color is changed. 

Similarly, reference numerals 207 to 209 denote second to fourth comparison units for comparing pixel 
data output from the sorting unit 201 and pixel data latched by the corresponding latch units 203 to 205, and 
supplying comparison results to a decoder 210. 

50 The decoder 210 receives the comparison results from the second to fourth comparison units 207 to 209, 

and outputs a 2-bit signal S2b. Note that the signal S2b is '00' when the second comparison unit 207 detects 
a coincidence; is '01' when the third comparison unit 208 detects a coincidence; is '10' when the fourth com- 
parison unit 209 detects a coincidence; and is Ml' when all the comparison results indicate a non-coincidence. 
More specifically, the signal S2b indicates which one of the latch units 203 to 205 latches data having the same 

55 value (same color) as that of pixel data output from the sorting unit 201 , and if none of the latch units 203 to 
205 latch pixel data having the same value, the signal S2b is '1V. 

Reference numeral 211 denotes a PLD (Programmable Logic Device) for receiving the signal S2a output 
from the first comparison unit 206, the signal S2b output from the decoder 210, and a pixel data signal S2c 

? 
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output from the sorting unit 201 , and outputting compressed data of the reversible compression section 3, and 
latch signals S2d to S2f to the second to fourth latch un its 203 to 205. Note that the PLD is an IC programmable 
by a designer himself or herself. 

Note that compressed data output from the PLD 211 has the relationship shown in Table 1 below. 
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Table 2 shows the relationship between the inputs to the PLD 211 and the latch signals S2d to S2f, and 
when the latch signal is ? 1', the corresponding latch unit latches input data. 
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As shown in Table 2, when the signal S2a is '0' {color is left unchanged), all the latch signals are '0' re- 
gardless of the state of the signal S2b; when the signal S2a is 'V (color is changed), and the signal S2b 
is '11- (pixel data having the same color is not latched), the content of the latch unit which latches the oldest 
pixel data is rewritten. 

Reference numeral 214 denotes an area discrimination unit for outputting a 1-bit signal S2g indicating a 
discrimination result, in accordance with the input signals S2a and S2b. Details of this area discrimination unit 
214 will be described later. Note that the states '0' and T of the signal S2g respectively indicate the discrim- 
ination results of "area 1 " and "area 2°. 

Reference numeral 213 denotes a backup unit for storing pixel data latched in the latch units before block 
processing is started for the discrimination processing of the area discrimination unit 214. When the signal 
S2g is V after discrimination, the backup unit 213 returns pixel data before area discrimination to the latch 
units. 

Fig. 3 is a block diagram showing the detailed arrangement of the area discrimination unit 214. 

10 
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Referring to Fig. 3, reference numerals 312 to 316 denote registers. 

Reference numeral 311 denotes an AND gate for outputting a total of 3-bit logical product of the signals 

S2a and S2b. . 

Reference numeral 301 denotes a counter a for counting the number of times of the signal S2a - 1, i.e., 
the number of times of appearance of color change points. Reference numeral 302 denotes a counter b for 
counting the number of times of the output = 'V from the AND gate 311. More specifically, the counter b 302 
counts the number of times of the signal S2a = T and the signal S2b = '11', i.e., the number of times of ap- 
pearance of non-latched colors. 

Reference numerals 303 and 304 denote multipliers. The multiplier a 303 multiplies the output from the 
counter a 301 with 2 (the number of bits of the signal S2b) stored in the register 312, and the multiplier b 304 
multiplies the output from the counter b 302 with 24 (the number of bits of pixel data) stored in the register 
313. 

Reference numeral 305 denotes an adder a for adding the output from the multiplier a 303, the output from 
the multiplier b 304, and 64 (the change point information number of colors) stored in the register 314, and 
outputting the number of bits (compressed data amount) D finally required for the corresponding block. Note 
that the change point information number of colors is a value determined by a preset block size, and is not 
limited to 64. 

Reference numeral 306 denotes a subtracter for outputting a result C-D obtained by subtracting the output 
D from the adder a 305 from a value C stored in the register 315. Note that the value C represents a target 
20 data size per block after compression. For example, if the target compression ratio of this embodiment is set 
to be 1/12, the value C is determined as follows using the block size and pixel data size: 
C = 8 x 8 x 24/12 = 1 28 [bytes] 
Reference numeral 307 denotes an adder b for outputting a result C+S-D obtained by adding the subtrac- 
tion result C-D from the subtracter 306 and an output S from a latch 310 (to be described later). 
25 Reference numeral 308 denotes a comparator for comparing the addition result C+S-D from the adder b 

307 with a value 0 stored in the register 316, and outputting the signal S2g representing the area discrimination 
result. Note that the signal S2g is '0' if C+S-D ^ 0; it is '1' if C+S-D < 0. As described above, the 
states '0' and 'V of the signal S2g respectively indicate the discrimination results of "area 1" and "area 2*\ 
More specifically, when the target compression ratio can be achieved by adding a stock S (to be described 
30 later) after block compression (C+S-D i= 0), the area discrimination unit 214 determines "area 1 - for reversibly 
compressing the block; when the target compression ratio cannot be achieved even if the stock S is added, it 
determines "area 2 n for irreversibly compressing the block. 

Reference numeral 310 denotes a latch which is initialized to a predetermined value by the control section 
10 at the beginning of compression processing. Thereafter, when each block is determined as "area 1", i.e., 
35 when the signal S2g is '0\ the latch 310 latches the output C+S-D from the adder b 307. More specifically, 
the latch 310 latches a stock C+S-D (> 0) with respect to the target compression ratio at that time after com- 
pression of one block, and outputs the latched data as a stock S. 

In this embodiment, a value "1 28", for example, is set as an initial value of the stock S. The stock S is not 
set to be 0 to cope with a case wherein a large number of different colors appear in the first block, More spe- 
40 cif ically, the compression method of the reversible compression section 3 requires 64 bits per block for infor- 
mation representing a color change point, and also requires 2 bits as latch information. at a color change point. 
Furthermore, when a non-latched new color appears, the compression method requires 24 bits for directly out- 
putting data of the color. If the number of color change points (the count value of the counter a 301 ) is repre- 
sented by n, and the number of times of appearance of non-latched new colors (the count value of the counter 
45 b 302) is represented by m, the following relationship is established: 
D = 64 + 2n + 24m 
.*. C + S - (64 + 2n + 24m) = 0 
for 0 ^n^64, O^m^n 

Therefore, with the compression method of the reversible compression section 3, if C = 128, S - 0, and m - 
so n in the first block, we have: 
n<(128-64)/26«2.4 

That is, since the upper limit of the number of colors is 2 in this case, a certain stock S must be initially prepared. 
For example, if C = S = 128, n < 7.3, and compression can be performed even when a maximum of seven 
colors appear when m = n. 

55 Fig. 4 is a block diagram showing the detailed arrangement of the ADCT compression section 4. 

Referring to Fig. 4, reference numeral 801 denotes a color space conversion unit for converting RGB color 
space data into YCrCb color space data. 

Reference numeral 802 denotes a DCT unit for performing DCT of YCrCb data output from the color space 
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conversion unit 801 to convert it into frequency space data. 

Reference numeral 803 denotes a quantization unit for quantizing DCT coefficients output from the OCT 
unit 802 using different step widths, respectively. 

Reference numeral 804 denotes an encoding unit for classifying quantized data output from the quantiza- 
tion unit 803 into DC coefficients and AC coefficients, and encoding these coefficients. More specifically as 
for DC coefficients, the encoding unit 804 forms an optimal Huffman encoding table on the basis of a histogram 
of differences from DC coefficients in the previous block, and encodes the DC coefficients in accordance with 
this table. Also, as for AC coefficients, the encoding unit 804 sorts the coefficients in a zigzag order, forms 
an optimal Huffman encoding table on the basis of combinations of a run length of coefficients 0 (the number 
of coefficients 0 until a coefficient x other than 0 appears) and the value x, and encodes the AC coefficients 
in accordance with this table. The encoding unit 804 outputs encoded data of the DC coefficients onto a line 
8a. and distributes and outputs encoded data of the AC coefficients onto respective lines. That is, the unit 804 
outputs, from the lower frequency side, p encoded data onto a line 8b, q encoded data onto a line 8c. r encoded 
data onto a line 8d, and so on. 

Although not described, the signals S2a, S2b, and S2c can be stored at different addresses on the first 
storage section 8 by the segment controller 6. 

Also, the latch units (the second to fourth latch units 203 to 205) for latching previous pixel data may be 
combined, and two latch units, i.e., the first and second latch units may be arranged. 

Fig. 5 is a block diagram showing another arrangement of the reversible compression section 3. In this 
arrangement, only one latch unit for storing previous pixel data is arranged, and no stock S is set. In this case 
the number of comparison units is decreased to two. the signal S2b is defined by 1 bit. and a formula for caK 
culating the compressed data amount is modified as follows: 
D = 64 + n + 24xm 

where 

n: the number of color change points (the count value of the counter a 301) 
m: the number of times of appearance of non-latched new colors (the count value of the counter b 302) 

In the reversible compression section 3, a latch unit to be updated when pixel data having the same value 
is not present in any latch units may be permanently assigned. For example, when the signal S2a is T and 
the signal S2b is the second latch unit 203 is updated. In this case, although compression efficiency is 
30 slightly impaired, the hardware arrangement can be simplified. 

In the above description, the segment controller 6 is used for memory control to perform data compression 
in a real-time manner. Alternatively, pre-scan (pre-development) may be performed to determine a S-factor of 
compression in advance, and then, compression may be performed. In this case, memory control can 
be facilitated. 

35 In this manner, since a block, which can achieve a target compression ratio, is compressed by the rever- 

sible compression section 3. and a block, which cannot achieve the target compression ratio, is compressed 
by the ADCT compression section 4, a computer-created image, for example, is reversibly compressed as much 
as possible to prevent deterioration of image quality, and image data such as a gradation image, a natural im- 
age, and the like, which cannot expect a sufficient compression ratio by reversible compression, is efficiently 

40 compressed by ADCT compression, thus preventing shortage of the memory. Note that a gradation image a 
natural, image, and the like have a feature that deterioration of image quality is not conspicuous even when 
these images are irreversibly compressed and expanded. . 

Furthermore, since reversible compression and irreversible compression can be switched in units of 
blocks, this embodiment is effective for both a natural image synthesized in a computer-created image and a 

45 computer-created image synthesized in a natural image. 

When the memory capacity for storing compressed data runs short even though compression is per- 
formed in the above-mentioned sequence, new compressed data are overwritten at addresses where ADCT- 
compressed data at the higher frequency side are stored, thereby preventing shortage of the memory. 

so [Second Embodiment] 

An image compression apparatus according to the second embodiment of the present invention will be 
described below. 

In the second embodiment, the reversible compression section 3 of the first embodiment is realized in a 
so tware manner. Therefore, the reversible compression section alone will be described hereinafter, and a de- 
lated description of the same arrangement as that in the first embodiment will be omitted 

Note that the contents of data names in the following description are as follows, and components in the 
parentheses correspond to those in the first embodiment. 
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next: first latch data (first latch unit 202) 

former[0]: second latch data (second latch unit 203) 

former[1]: third latch data (third latch unit 204) 

former[2]: fourth latch data (fourth latch unit 205) 

5 present pixel data output in zigzag order (output from sorting unit 201 ) 

turn: latch updating information 

Note that "next", "formenT, and "present" are pixel data in the RGB format, and have R, G. and B data, re- 
spectively. 

Fig. 6 is a flow chart showing a reversible compression sequence of this embodiment. 
10 Referring to Fig. 6, in this embodiment, a stock S is initialized to, e.g.. 128 in step S401, and four latch 

data "next" and "formenT are initialized in step S402. In this embodiment, assuming that a black image, a red 
image, and a blue image on a white background have high appearance frequencies in this order, white data 
is set in "next", black data is set in "formertO]", red data is set in "former^]", and blue data is set in "former^]" 
as follows: 
15 next = (255, 255, 255) 

formertO] = (0, 0, 0) 
former[1] = (255, 0,0) 
former[2] = (0, 0, 255) 

In step S402, if "present" does not coincide with any "former[]\ "turn" for rewriting the oldest "formerf.]" 's 
20 set as follows: 
turn = 0 
turn_p = 1 
turn jp = 2 

In step S403, pixel data "next", TormenT, and "turn" are backed up. 
25 Bnext <~ next f ' ; * 

Bformer[] *- formerfj 
Bturn <- turn 
Bturn_p <- turn_p 
Bturn_pp<- turn_pp 

30 In step S404, one block is reversibly compressed to obtain a compressed data amount D, as will be de- 

scribed in detail later. 

In step S405, the compressed data amount D obtained in step S404 is compared with a limit value L ob- 
tained by adding the stock S to a preset value C. If D ^ L. "area 1" is determined, and the flow advances to 
step S406; if D > L, "area 2" is determined, and the flow advances to step S408. 
35 If the discrimination result indicates "area 1", a signal S2g of state "0" is output in step S406, and the stock 

S is updated using the following formula in step S407. Thereafter, the flow advances to step S410. 
S«-C + S-D 

If the discrimination result indicates "area 2", the signal S2g of state "I" is output in step S408, and the 
backed-up pixel data are restored to "next", "former[]" f and "turn" in step S409. Thereafter, the flow advances 
40 to step S410. More specifically, in step S409, latch data rewritten in the processing in step S404 are restored 
to pixel data before the processing, 
next <r- Bnext 
forrher[] <- Bformer[] 
turn <r- Bturn 
45 turn__p <r- Bturn_p 

turn_pp <r- Bturn_pp 

In step S410, it is checked if all blocks are processed. If NO in step S41.0, the flow returns to step S403 
to process the remaining blocks; otherwise, the processing is ended. 

The processing sequence of reversible compression (step S404) will be described below. Note that data 
so names in the following description, and components in the parentheses correspond to those in the first em- 
bodiment. 

count2: the number of times of appearance of color change points (counter a 301) 
count3: the number of times of non-coincidence with any of latch data (counter b 302) 
pix[i]: i-th pixel data 

55 Figs. 7 and 8 are flow charts showing the sequence of the reversible compression processing (step S404). 

Referring to Fig. 7, in this embodiment. "count2 M and "count3 a are initialized to 0 in step S501 , and 0 is set 
in a counter i in step S502. Note that the counter i counts the number of processed pixels, and in this embodi- 
ment, pixels are processed in the order shown in Fig. 9. 
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In step S503, °pix[i]° is substituted in "present", and in step S504, "present" is compared with "next". If the 
two data coincide with each other, compressed data '0' is output in step S505; otherwise, "area 2" processing 
in step S506 is executed, as wfll be described in detail later. More specifically, since the present pixel data 
(present) and immediately preceding pixel data (next) are compared with each other in step S504, a coinci- 
dence between the two data indicates that the color is left unchanged, and a non-coincidence between the 
two data indicates that the color is changed. 

In step S507, pixel data latched in "present" is substituted in "next", and in step S508, the counter i is in- 
cremented. In step S509, the value of the counter i is checked. If i ^ 63, the flow returns to step S503 to process 
the remaining pixels; if i > 63, the flow advances to step S510. 

If processing of all pixels is completed (i > 63), the compressed data amount D of the corresponding block 
is calculated using the following equation in step S510, and the flow then returns to the processing sequence 
shown in Fig. 6. 

D = 64 + 2 x count2 + 24 x count3 

On the other hand, if it is determined in step S504 that present * next, a processing sequence shown in 
15 Fig. 8 is executed. 

Referring to Fig. 8, in this embodiment, compressed data *r is output in step S601 , "count2" is incremented 
in step S602, and "turn" and "turn_p" are compared with each other in step S603. If the two data coincide with 
each other, the flow jumps to step S605; otherwise, the flow advances to step S604. In step S604, the latch 
number of "turn_p" is substituted in "turn_pp", and thereafter, the latch number of "turn" is substituted in 
"turn jpr. Note that this processing is to inhibit giving of the same value to "turn" and "turn _p B . 

In step S605, "present" and "formenT are compared with each other. If present = former[0], the flow ad- 
vances to step S606; if present = former[1], the flow advances to step S608; if present * fbrmer[2], the flow 
advances to step S610; if present * former[], the flow advances to step S612. 

If present = former[0] f compressed data '00' is output in step S606, and a value '0* is set in "turn" in step 
S607, thereby indicating the latch number tobe updated. If present = former[1], compressed data '0V is output 
in step S608, and a value '1 ■ is set in "turn" in step S609. If present = former[2], compressed data *1 0' is output 
in step S610, and a value *2' is set in "turn" in step S611. 

If present *former[], compressed data '11' is output in step S612, and pixel data latched in "present" is 
output in step S613. In step S614, "count3" is incremented, and in step S615, a latch number different from 
those in "turn _p- and "turn_pp" is set in "turn". Since the same value is inhibited from being set in "turn_P" 
and °turn_pp" in steps S603 and S604, "turn" assumes one of values '0 r t "1\ and '2'. 

In step S616, pixel data latched in "next" is substituted in "former[turn]" f and thereafter, the flow returns 
to the processing sequence shown in Fig. 7. 

Since a computer- created image created by, e.g., DTP uses a relatively small number of colors, and can 
be sufficiently expressed by 256 colors, a look-up table can be used for the present value "present" output in 
step S613 in the above description. For example, an 8-bit (256 colors) memory is prepared, and data of 8 
bits/pixel is output until the 256th color appears. When the 256th color appears, data of 24 bits/pixel is directly 
output, thus providing an arrangement, which has no limitation on the number of colors. 

The present value "present" to be output in step S613 may be, e.g., 18-bit data in place of 24-bit data. In 
this case, although reversible compression is disabled, since gradation characteristics for human eyes are not 
important in a high-frequency image such as a computer-created image, a compressed data amount in this 
case is given by: 

D = 64 + 2 x count2 + 18 x count3 
The number of "formers for latching previous data may be reduced to 1. In this case, a 1-bit signal is output 
in step S606, S608, S610, or S612, and since the number of latches to be substituted with pixel data latched 
in "next" is one. "turn" indicating the updating order can be omitted, in this case, an equation for calculating 
the compressed data amount is rewritten as follows: 
D = 64 + count2 + 24 x count3 
In this manner, in addition to the same effect as in the first embodiment, since the reversible compression 
section is realized by a software program to reversibly compress data and to calculate the compressed data 
amount D, the hardware arrangement can be simplified. 

[Third Embodiment] 

A data expansion apparatus according.to the third embodiment of the present invention will be described 
below. 

In the third embodiment, compressed data stored in the first and second storage sections 8 and 9 shown 
in Fig. 1 are expanded to reproduce image data. 
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Fig. 10 is a block diagram showing an arrangement of a data expansion apparatus according to this em- 
bodiment . 

Referring to Fig. 10, reference numeral 901 denotes.a segment controller for distributing compressed data 
stored in the first storage section 8 to.an ADCT expansion section 902 or a reversibly compressed data ex- 
5 pansion section 904 with reference to the segment information table 7 shown in Fig. 1. The ADCT expansion 
section 902 expands irreversibly compressed data to reproduce an 8 x 8 pixel block. The reversibly compressed 
data expansion section (to be simply, referred to as "expansion section* hereinafter) 904 expands reversibly 
compressed data on the basis of area information stored in the second storage section 9, thus reproducing 
an 8 x 8 pixel block. 

10 Reference numeral 906 denotes a selector for selecting and outputting one of the block input from the 

ADCT expansion section 902 and the block input from the expansion section 904 on the basis of area infor- 
mation stored in the second storage section 9. 

Reference numeral 907 denotes an image data storage section for sequentially storing blocks output from 
the selector 906 to reproduce image data in the NTS C- RGB format defined by 24 bits/pixel. 

15 Reference numeral 910 denotes a control section for con trolling, e.g., the operation timings of the arrange- 

ment of this embodiment. 

Fig. 11 is a flow chart showing a processing sequence for realizing the reversibly compressed data ex- 
pansion section 904 in a software manner. Note that data names are the same as those in the second em- 
bodiment. 

20 Referring to Fig. 1.1, in this embodiment, in step S1001, "next", "formeitr, and "turn" are initialized as in 

step S402 in the second embodiment If it is determined in step S1002 that area information of a processing 
block read out from the second storage section 9 indicates "area 1", expansion processing is executed in step 
S1003, as will be described in detail later, and the flow then advances to step S1004; if the area information 
indicates "area 2", the flow jumps to step S1004. 
25 In step S1004, it is checked if expansion of all compressed data is completed. If NO In stepiS1G04, the 

flow returns to step S1002; otherwise, the processing is ended. 

Fig. 12 is a flow chart showing a sequence of reversible expansion processing (step S1003). 
Referring to Fig. 12, in this embodiment, a value '0' is set in a counter i in step S1 101. Note that the counter 
i counts the number of processed pixels, and in this embodiment, pixels are processed in the order shown in 
30 Fig. 9 as in the second embodiment 

In step S1102, 1-bit data received from the first storage section 8 is checked. If the received data is f 1\ 
the flow advances to step S1103; if the received data is '0\ the flow jumps to step S1113. 

If the 1-bit data received from the first storage section 8 is 'V, "turn" and n turn_p" are compared with each 
other in step S1103. If the two data coincide with each other, the flow advances to step S1105; otherwise, 
35 the flow advances to step S1104. In step S1104, a latch number of "turn_p" is substituted in "turn_pp", and 
thereafter, a latch number of "turn" is substituted in "turn_p". Note that this processing is to inhibit giving of 
the same value to "turn" and "turn_p" . 

If it is determined in step S1105 that 2-bit data received from the first storage section 8 is '00', the flow 
advances to step S1106; if the data is '01 \ the flow advances to step S1107; if the data is '10*, the flow ad- 
40 vances to step S1108; or if the data is '11% the flow advances to step S1110. 

If the 2-bit data is '00\ a value '0' is substituted in "turn" in step S1106, and the flow then advances to step 
S1109. If the 2-bit data is *01\ a value '1* is substituted in "turn" in step S1107, and the flow then advances to 
step S1109. If the 2-bit data is '10\ a value '2' is substituted in "turn" in step S1108, and the flow then advances 
to step S 11 09. More specifically, when the 2-bit data received from the first storage section 8 is '00', '0T. 
45 or , io\ pixel data to be output is one latched in "former[0]", "former[1] n , or "formert2] n . 

In step S1109, pixel data latched in "next" is replaced with pixel data latched in "former[turn]", and there- 
after, the flow advances to step S11 13/ 

On the other hand, if the 2-bit data received from the first storage section 8 is '11', a latch number different 
from those of "turn_p" and "turn_pp" is set in "turn" in step S1110, pixel data latched in "next" is substituted in 
so "former[turn]" in step S1111 , and 24-bit pixel data received from the first storage section 8 is substituted in "next" 
in step S1112. Thereafter, the flow advances to step S1113. Since the same value is inhibited from being set 
in "turn_p" and "turn _pp" in steps S1 103 and S11 04, "turn" assumes one of values '0\ '1 \ and '2* in step S111 0. 

In step S1113, pixel data latched in "next" is output as an expansion result, and in step S1114, the counter 
; i is incremented. In step S1115, the value of the counter i is checked. If i ^ 63, the flow returns to step S1102 
55 to process the remaining pixels; if i > 63, the flow returns to the processing sequence shown in Fig. 11. 

In this manner, in order to prevent deterioration of image quality, and to achieve a target compression ratio, 
compressed data obtained by reversibly compressing some image data, and irreversibly compressing some 
other image data can be properly expanded according to the compression methods. 
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Since reversibiy compressed data and irreversibly compressed data can be expanded in units of blocks, 
this embodiment is effective for both a natural image synthesized in a computer-created image and a computer- 
created image synthesized in a natural image. 

s [Modification of First to Third Embodiments] 

In each of the above-mentioned embodiments, the memory is divided into segments using the segment 
controller, and new compressed data are overwritten in an orderfrom segments storing ADCT-com pressed data 
at the higher frequency side, t hereby achieving a target compression ratio. Alternatively, area information may 
10 be formed in the second storage section in the first compression processing to calculate an ADCT 5-factor for 
achieving a target compression ratio, and the target compression ratio may be achieved in the second com- 
pression processing. In this case, complicated memory control processing can be omitted. 

In the first and second embodiments described above, reversibiy compressed data output from the rever- 
sible compression section, i.e., the signals S2a and S2b are constituted by a flag system indicating ON/OFF 
15 COVT), but may be constituted by a trigger system. 

Figs. 13Aand 13B are charts for explaining a difference between the flag system and the trigger system. 
Fig. 13A shows the flag system, and Fig. 13B shows the trigger system. 

As can be seen from Figs. 13A and 13B, identical data tend to continue for a longer period in the trigger 
system than in the flag system. By utilizing this nature, the signals S2a and S2b may be subjected to another 
20 run length compression such as MH (Modified Huffman) to decrease the data amount 

The present Invention is not limited to MH. For example, completed compressed data may be subjected 
to Huffman encoding or Lempel-Zfv encoding to be further compressed. Note that it is also effective to perform 
Huffman encoding or Lempel-Ziv encoding of the signal S2c. 

25 [Fourth Embodiment] 

[Summary of Compression Method] 

A summary of a compression method according to the present invention to be used in the following em- 
30 bodiments will be described below. 

In a so-called CG image created on a computer, a single figure is normally expressed by a uniform color 
although the image is a "full-color image". As a typical computer-created image, an image in which characters 
are formed on a background color, as shown in Fig. 27A, or an image in which a figure is formed on a back- 
ground color, and characters are formed thereon, as shown in Fig. 27B, is proposed. More specifically, such 
35 an image has the following tendencies: 

(a) An identical color tends to continue. 

(b) Even if a color is changed from A to B, it tends to be returned to A again. 
A checkerboard pattern is a typical example of (b). 

Therefore, according to the present invention, when a pixel to be processed (to be referred to as a "pixel 
40 of interest" hereinafter) has the same color data as color data (C,) of the immediately preceding pixel, the short- 
est code (e.g., '1') is output; when a pixel of interest has the same value as color data (C 2 ) of a pixel, which 
has color data different from C 1( and appears latest, the next shortest code (e.g., '01') is output; when a pixel 
of interest has the same value as color data (C 3 ) of a pixel, which has color data different from Ca and C lf and 
appears latest, the next shortest code (e.g., '001 ') is output; when a pixel of interest has color data different 
45 from C 1f C2, and C 3 , an unused code (e.g., '000') is output, and color data at that time is output. Thus, a com- 
puter-created image can be compressed at a high compression ratio without deteriorating image quality. 

An image processing method and apparatus according to an embodiment using this compression method 
will be described in detail hereinafter with reference to the accompanying drawings. 

so [Data Compression Apparatus] 

Fig. 28 is a block diagram showing an arrangement of a data compression apparatus which can realize 
the present invention. 

Reference numeral 101 denotes a pixel data generation section for generating 24-bit (8 bits/color) pixel 
55 data per pixel in the NTSC-RGB format. 

Reference numeral 1 02 denotes a first flip-flop (to be referred to as "FF" hereinafter) section for holding 
pixel data (24 bits) from the pixel data generation section 101 in synchronism with the trailing edge of a.pixel 
generation clock (to be simply referred to as "clock" hereinafter) CLK. Reference numeral 1 03 denotes a second 
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FF section for receiving an output d1 from a first comparison section 105 as a write enable signal, and holding 
pixel data output from the first FF section 102 in synchronism with the clock CLK. Reference numeral 104 de- 
notes a third FF section for receiving an OR of the output dl from the first comparison section 105 and an output 
d2 from a second comparison section 106 as a write enable signal, and holding pixel data output from the sec- 
5 ond FF section 103 in synchronism with the clock CLK. 

Reference numeral 105 denotes a first comparison section for comparing pixel data from the pixel data 
generation section 101 and pixel data held in the first FF section 102, and for, when the two data are equal to 
each other, outputting T; otherwise, outputting '0'. Reference numeral 106 denotes a second comparison sec- 
tion for comparing pixel data from the pixel data generation section 101 and pixel data held in the second FF 
w section 103, and for, when the two data are equal to each other, outputting T; otherwise, outputting T>\ Ref- 
erence numeral 107 denotes a third comparison section for comparing pixel data from the pixel data generation 
section 101 and pixel data held in the third FF section 104, and for, when the two data are equal to each other, 
outputting T; otherwise, outputting '0*. 

Reference numeral 109 denotes a control section for receiving the comparison results from the three com- 
15 parison sections, and pixel data from the pixel data generation section 101 . and outputting encoded data. More 
specifically, the control section 109 can be realized by, e.g., a PLD. 

Reference numeral 1 1 0 denotes a communication interface for adding a communication header to encoded 
data input from the control section 109, and transmitting the data. 

As described above, the write enable signal of the second FF section 103 can be controlled by the conrv- 
20 parison result from the first comparison section 105, and the write enable signal of the third FF section 104 
can be controlled by the comparison results from the first and second comparison sections 105 and 106. Al- 
ternatively, the control section 109 may output write enable signals for the second and third FF sections 103 
and 104. Furthermore, a memory may be arranged in place of the communication interface 110. 
Fig. 29 is a flow chart showing an encoding processing sequence of the control section 109. 
25 Referring to Fig. 29, a block 401 corresponds to the comparison sections 105, 106, and 107 shown in Fig. 

28. In the block 401, reference symbol X denotes pixel data of interest; C 1f data held by the first FF section 
102; Ca, data held by the second FF section 103; and C3, data held by the third FF section 104. A comparison 
result group 401d in the block 104 is supplied to the control section 109. 

Also, a block 402 corresponds to the control section 109. The block 402 outputs '1' when (d1, d2, d3) = 
30 (1, 0. 0);'01' when (d1 , d2, d3) = (0, 1, 0); '00T when <d1. d2, d3) = (0, 0, 1); and '0Q0X* (all 27 bits) when (d1, 
d2, d3) = (0, 0, 0). In this case, data such as (1, 1, 0) is not considered since the first, second, and third FF 
sections 102, 103, and 104 always have different values, and two signals never become 'V at the same time. 

In step S403, when (d1, d2, d3) = (0, 0, 1) or (0, 0, 0), since the write enable signal (d1/d2) to the third FF 
section 104 is '0\ data held by the third FF section 104 is rewritten with data C2 as an output from the second 
35 FF section in synchronism with the trailing edge of the clock CLK corresponding to the beginning of the next 
pixel. 

In step S404, when (d1, d2, d3) = (0, 1, 0), (0, 0, 1) or (0, 0, 0), since the write enable signal (d1) to the 
second FF section 103 is '0\ data held by the second FF section 103 is rewritten with data as an output 
from the first FF section in synchronism with the trailing edge of the clock CLK corresponding to the beginning 
40 of the next pixel. 

In step S405, the value X of the pixel of interest is written in the first FF section 102. 

The above-mentioned processing is executed every time pixel data is generated by the pixel data gener- 
ation section 101. The above-mentioned encoding processing state will be described below with reference to 
an actual data example. 

45 Fig. 30A shows an example of pixel data generated by the pixel data generation section 101. Time lapses 

from the left to the right in Fig. 30A, and data are output from the pixel data generation section 101 like A, A, 
B, B, B,... in synchronism with the clocks CLK. A, B, C. and D represent different 24-bit pixel data, and for ex- 
ample, data A has a value *1 1 01 00001 01 10111 00001 111'. 

Fig. 30B shows changes of data held in the first, second, and third FF sections 102, 103, and 104. Note 

so that white, black, and red at the left ends of the charts represent reset values of the FF sections. In this em- 
bodiment, the f irst FF section 102 is reset to white , 111111111111111111111111\ the second FF section 103 is 
reset to black '000000000000000000000000', and the third FF section 104 is set to 
red '111 11 11 10000000000000000*. 

Fig. 31 shows changes of the data shown in Figs. 30A and 30B. 

55 Referring to Fig. 31, reference symbol CLK denotes a clock indicating one pixel; d1, an output from the 

first comparison section 105; d2, an output from the second comparison section 106; and d3, an output from 
the third comparison section 107. Reference numeral d4 denotes a write enable signal for the second FF sec- 
tion 103, which signal coincides with the output from the first comparison section 105. Reference numeral d5 
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denotes a write enable signal for the third FF section 104, which signal corresponds to an OR of the outputs 
from the first and second comparison sections 105 and 106. Note that the signals d1 to d5 change to be slightly 
delayed from the waveform of the dock CLK. 

Encoding processing of the data shown in Fig. 30AwiII be described below with reference to the flow chart 
5 shown in Fig. 29. 

The first data A (1 301 ) is different from any of = "white", C 2 = "black 0 , or C 3 = "red". Therefore, as shown 
in Fig. 31, all the signals d1, d2, and d3 are '0' (401). According to the block 402 in Fig. 29, when (d1, d2, d3) 
= (0, 0, 0), the flow branches to step S402d to output 'OOOX*. Therefore, in this case, , O0OA is output More 
specifically, 27-bit data , 00011010000ldl10111000011ir is output In this case, the write enable signal d5 
10 goes LOW since (d1/d2) = '0\ and data output from the first FF section 102 is input to the third FF section 104 
in synchronism with the trailing edge of the next clock CLK. The content of the first FF section 102 is rewritten 
with data from the pixel data generation section 101 in accordance with the clocks CLK. Therefore, in the state 
of Ci = A, C2 = "white", and C 3 = "black", processing of data A (1302) as the next pixel is started. 

Note that a mark A in Fig. 31 indicates a point where the write enable signal is at LOW level, and the clock 
15 CLK goes LOW. 

When the data A (1302) is processed, since (d1 , d2, and d3) = (1 , 0, 0) is obtained, the flow branches to 
step S402a to output '1'. In this case, since the signals d4 and d5 are at HIGH level, the contents of the second 
and third FF sections 103 and 104 are not rewritten. 

In Fig. 30B, in this embodiment, the content of the first FF section 102 is rewritten in synchronism with 
20 the clock CLK. However, the first FF section 102 may be write-enabled by a signal from the first comparison 
section 105. Also, arrows in the outputs and C3 represent that data are left unchanged. 

Processing of pixel data 1303 in Fig. 30A will be described below. At this time, C, = B, C2 = A, and C3 = 
"white", and X = A, (d1, d2, d3) = (0, 1, 0). Therefore, the flow branches to step S402b to output '01 \ In this 
case, since (d1/d2) = T, the content of the third FF section 104 is not rewritten, and since d1 = , 1\ data in the 
25 second FF section 103 is rewritten. 

Processing of pixel data 1304 in Fig. 30A will be described below. At this time, C, = C, C 2 = B, and C 3 = 
A, and X = A, (d1, d2, d3) = (0, 0, 1). Therefore, the flow branches to step S402c to output '001'. In this case, 
since (d1/d2) = 'V and d1 = M", both the signals d4 and d5 go HIGH, and the contents of the second the third 
FF sections 1 03 and 1 04 are rewritten. 
30 Thus, all the cases of code patterns '1\ *0V t '00V, and '000X' have been described. 

As can be seen from Fig. 30B, the first, second, and third FF sections 102 (CO, 103 (C2), and 104 (C 3 ) 
always hold different values. With this processing, data shown in Fig. 30A, i.e., 32 x 24 = 768 bits, are com- 
pressed to data shown in Fig. 32, i.e., 148 bits, and a compression ratio of about 1/5 is achieved. 

In the data example shown in Fig. 30A, a continuous string of single data is shortened for the purpose of 
35 descriptive convenience. However, since actual data includes a longer string of single data, the compression 
ratio can be further increased, and a compression ratio as high as about 1/20 can be achieved even for a con- 
siderably fine image. 

Fig. 33 is a block diagram showing an arrangement of a data expansion apparatus for decoding encoded 
data output from the data compression apparatus shown in Fig. 28. Referring to Fig. 33, no data exchange 
processing among FF sections is performed unlike in an encoding mode. In the data expansion apparatus, a 
parameter representing the priority order of each FF section, called "state", is provided, and decoding proc- 
essing is performed by utilizing this parameter. 

Reference numeral 700 denotes a communication interface for analyzing a communication header of re- 
ceived encoded data. Reference numeral 701 denotes a buffer for buffering data from the communication in- 
45 terface 700. Reference numeral 702 denotes a shift register for converting serial data input from the buffer 
701 into parallel data. 

Reference numeral 703 denotes a state storage buffer for storing the present state of six different states 
representing the priority order of three FF sections. Reference numeral 704 denotes a PLD for receiving 3-bit 
data from the state storage buffer 703, and upper 3 bits of encoded data in the shift register 702, and outputting 
so 3-bit data representing the next state, a 2-bit select signal for selecting color data, write enable signals for three 
FF sections, and a shift count or a shift dock signal for the shift register 702. 

Reference numerals 705 to 707 denote fourth to sixth FF sections for, when corresponding write enable 
signals from the PLD 704 are at LOW level, holding data in synchronism with the trailing edge of a clock, re- 
spectively. 

Reference numeral 708 denotes a selector for selecting and outputting one of four color signals (24-bit par- 
allel data from the fourth to sixth FF sections 705 to 707, and the shift register 702) in accordance with the 
select signal from the PLD 704. 

Fjg. 34 shows the processing content of the PLD 704. Referring to Fig. 34, if encoded data '01 *' is.input 
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when the state (priority order) is *0\ the PLD outputs a select signal for selecting color data C 5 of the fifth FF 
section 706, sets the write enable signals to be (H, H, H) so as not to rewrite the contents of any latches, 
changes the state to be *2\ and outputs a shift count , 2 f of the shift register 702. 

As another example, if encoded data '000' is input when the state is %\ the PLD outputs a select signal 
5 for selecting 24-bit parallel data from the shift register 702. In this case, since the priority order is (U 2 , U 3 , U,), 
the PLD sets the write enable signals to be (L, H. H) to rewrite the content of the fourth FF section 705 so as 
to rewrite the oldest data U 1f and changes the state to be '0' so as to set the priority order (U 1? U 2 , U 3 ). Then, 
the PLD outputs a shift count '72* of the shift register 702. 

Fig. 35 is a flow chart showing decoding processing. Decoding processing of encoded data shown in Fig. 
10 32 will be exemplified below with reference to Fig. 35. 

The same reset values (white, black, red) as in the encoding mode are held in the fourth, fifth, and sixth 
FF sections 705, 706, and 707 (step S901). Therefore, = "white". U 2 = "black", and U 3 = "red". 

The state is reset to '0' (step S902). If encoded data shown in Fig. 32 is input to the shift register 702. upper 
3-bit data to be processed first is , 000*. According to Fig. 34. color data A parallelly output to the 4th to 47th 
15 pins of the shift register 702 is selected in accordance with an instruction from the PLD 704 (step S903). 

Since the write enable signals are (H, H. L) via steps S904 and S908, the color data A is written in the 
sixth FF section 707 (step S909), '3' is substituted in the state (step S910), and the shift register 702 is shifted 
27 times (step S911). 

The next data is MOO', and coincides with '1**'. According to Fig. 34, if '1**' is input when the state - 3, 
20 data U 3 , i.e., the sixth FF section 707 is selected to output the data A, none of the FF sections are rewritten, 
and the state is left unchanged. Since the shift count is '1\ the shift register is shifted once, and the next data 
is '000'. 

When the state = 3, and the next data is 'Q00\ 24-bit data B in the shift register 702 is selected, color data 
B is substituted in the fifth FF section 706, the state is changed to be '4', and the shift register is shifted by 
25 27 bits. 

The next data is'111*. Since this data coincides with '1 data U 2 is selected, the state is left unchanged, 
and the shift register is shifted by 1 bit. 

Since the following data are '110' and '10V, the same processing is repeated twice. Thereafter, the next 
data is '011', and coincides with '01 *\ If the data '01*' is input when the state = 4, data U 3 is selected, none 
30 of the FF sections are rewritten, the state is changed to be *5\ and the shift register is shifted twice. 

With the above-mentioned processing, decoded data (Fig. 36C) which is the same as that before encoding 
can be obtained via processes shown in Figs. 36Ato 36C. Fig. 36A shows the change of the state, and Fig. 
36B shows the changes of the FF sections. In Fig. 36B, a symbol with a mark O represents color data selected 
at that time. Arrows indicate that data are left unchanged. As can be apparent from the above description, the 
35 number of times of rewriting of the FF sections can be greatly decreased by utilizing the "state" parameter.. 

[Fifth Embodiment] 

An application of multi-value image compression using the above-mentioned reversible compression 
40 (which will sometimes be referred to as "CG compression" hereinafter) will be described below. 

[Compression Processing] 

A raster-block conversion section for holding pixel data groups each including m (horizontal) x n (vertical) 
45 input pixel data (to be referred to as a "block" hereinafter), and one pixel type information group per pixel (a 
natural image pixel will be defined as "pixel type A", and another image will be defined as "pixel type B w ) is 
arranged, and when all pieces of pixel type information in a block are "pixel type A", ADCT-compressed data 
is output. 

On the other hand, when all pieces of pixel type information in a block are "pixel type B", a CG-compressed 
so data amount D is compared with a given limit value L, and when D ^ L, CG-compressed data is output; when 
D > L, ADCT-compressed data is output. 

When a single block includes pixel data of both pixel types A and B, pixel data of the pixel type A is replaced 
with predetermined pixel data a, and pixel data of the pixel type B, which data has the same value as the pixel 
data a is replaced with predetermined pixel data B. The CG-compressed data amount D at that time is com- 
55 pared with the given limit value L. When D ^ L, CG-compressed data of the substituted pixel data group are 
output, and ADCT-compressed data of a pixel data group, which is interpolated excluding pixel data of the pixel 
type B, are output When D > L, ADCT-compressed data is output. 

Also, a compression memory for storing the output ADCT-compressed data and CG-compressed data is 

19 



EP 0 583 107 A2 



10 



15 



20 



25 



35 



40 



45 



50 



55 



arranged. Furthermore, a block map memory which stores 1-bit data per block, i.e. ( a signal '0' for a block for 
which CG-compressed data is output, and a signal T for another block, is arranged. 

ADCT-compresseti data are divided into p Huffman codes, q Huffman codes, r Huffman codes,..., and are 
stored in the compression memory together with the CG-compressed data The compression memory is con- 
trolled by a segment controller, and the write addresses of compressed data are stored in a segment information 
table. 

When the memory capacity runs short during the above-mentioned compression processing, new com- 
pressed data are overwritten on least important divided ADCT-compressed data in turn with reference to the 
segment information table, thereby achieving a constant memory amount 

[Expansion Processing] 



One-bit data "blockmap" is read out from the block map memory. When the data "blockmap" is *1 \ ADCT- 
compressed data read out from the compression memory are expanded, and the expanded data are written 
in a block-raster conversion section. When the data "blockmap" is T, CG-compressed data read out from the 
compression memory are expanded, and pixel type information is analyzed to form a pixel type information 
bit map. 

If the formed bit map indicates at least one pixel of the pixel type A, ADCT-compressed data read out from 
the compression memory are expanded. As for a pixel corresponding to the pixel type A indicated by the bit 
map, ADCT expanded data are written in the block-raster conversion section, and as for a pixel corresponding 
to the pixel type B, CG expanded data are written. 

When all pixels of the formed bit map indicate the pixel type B, CG expanded data are written in the block- 
raster conversion section. 

In the above-mentioned compression/expansion processing, a problem associated with image quality or 
a compressed data amount, which is posed by a block including both the pixel types A and B; is solved by 
replacing and CG-compressing pixel data, and interpolating and ADCT-com pressing pixel data. Since pixel type 
data per pixel, which. is required since the two different kinds of compressed data are used, can be inserted 
in CG-compressed data, no extra bit map memory is required. Furthermore, when the CG-compressed data 
amount D exceeds the limit value L, the compression method is switched to the ADCT compression method, 
30 thereby achieving a constant memory amount 

Note that the raster-block conversion section, and the block-raster conversion section are buffers, and a 
single buffer may be used. 



[Image Data Compression Apparatus] 

An example of an apparatus for realizing the above-mentioned processing will be described below with 
reference to the drawings. In this embodiment, m = 8 and n = 8 are used. However, the present invention is 
not limited to this. (For example, when color different components are sampled by the ADCT method, m = 16 
and n - 8 are selected.) The limit value L is assumed to be a sum of a constant value C indicating an allowable 
memory amount of a block to be processed, and a stock S as accumulated unused allowable memory amounts 
of blocks processed so far. 

Fig. 37 is a block diagram showing a functional arrangement of an image data compression apparatus ac- 
cording to this embodiment 

Reference numeral 11 denotes a raster-block conversion section for holding pixel data (24 bits per pixel) 
in the NTSC-RGB format, and pixel type information (1 bit per pixel; '1' as a pixel type A for a natural image 
pixel; '0' as a pixel type B for another image pixel) for eight lines, and parallelly generating pixel data 1a and 
pixel type information 1 b for one block. In this embodiment the pixel type information is generated by a page 
descnption language (PDt) development section 26 upon development of PDL data from a host computer 25 

Reference numeral 12 denotes a delay section for delaying and holding data (1 a and 1 b) for one block out- 
put from the raster-block conversion unit 11 since the necessity of ADCT compression processing (to be de- 
scribed later) is determined depending on the above-mentioned CG compression processing result 

Reference numeral 13 denotes a pixel data interpolation section for interpolating data 1a' read out from 
the delay section 1 2 under the control of a signal 1f. The signal 1 f is 1 -bit data per pixel generated by logically 
ORmg signals 1b' and 1e. For example, when the signal 1 b' shown in Fig. 38A is output, if the signal 1e is '<r 
the signal 1f shown in Fig. 38B is output; if the signal 1e is '1\ the signal 1f shown in Fig. 38C is output Data' 
corresponding to a position where the signal 1f = '0' is extracted and interpolated to eliminate a steep edge in 
a block. For example, in a certain method, an average value of pixel data corresponding to the signal 1f 
- T may be calculated, and the calculated average value may be used as the value of pixel data corresponding 
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to the signal 1f = f 0\ 

Reference numeral 14 denotes an ADCT section for, when the signal 1g = T, receiving data from the pixel 
data interpolation section 13, executing ADCT compression processing (to be described later), dividing com- 
pressed data into many stages, and outputting divided compressed data. The signal 1g is 1-bit data per block, 
5 which is T when the signal 1e is T (i.e., the CG-compressed data amount D > L or D = 64) or when a signal 
1c is T (i.e., at least one pixel type signal 1b indicates the pixel type A). 

Reference numeral 15 denotes a pixel type information analysis section for generating a 1-bit signal 1c 
per block which is 'V when at least one pixel type information 1b in a block to be processed indicates the pixel 
type A, or which is '0' for other cases, and a 1-bit signal 1d per block, which is '1' if at least one pixel type in- 
fo formation 1b indicates the pixel type B. or which is W for other cases. 

Reference numeral 17 denotes a pixel data replacing section for receiving pixel data 1a and pixel type in- 
formation 1b from the raster-block conversion section 11, replacing pixel data having pixel type information 
1b indicating the pixel type A with predetermined pixel data a, and replacing pixel data having the pixel type 
B and having the same value as that of the pixel data a with pixel data p. 
is Reference numeral 18 denotes a reversible compression section (the above-mentioned CG compression 

section) for receiving replaced data from the pixel data replacing section 17 (corresponding to the pixel data 
generation section 101 in Fig. 28), executing CG compression processing with reference to the signals 1c and 
1d, and outputting compressed data (corresponding to the output from the control section 109 in Fig. 28) and 
an area discrimination result 1e. The discrimination result 1e is a 1-bit signal per block, which is T when D > 
20 L or D = 64, or which is '0* in other cases. 

Reference numeral 1 9 denotes a compressed data holding section for temporarily holding CG-compressed 
data for the purpose of synchronization, and for, when a signal 1h is '1', outputting compressed data. The signal 
1h is a 1-bit signal per block, which is '1' when the signal 1e is '0* and the signal 1d is T, or which is '0' in other 
cases. 

25 Reference numeral 20 denotes a segment controller for receiving CG-compressed data from the com- 

pressed data holding section 19, and compressed data divided into many stages from the ADCT section 14, 
and controlling memory addresses for storing these data in a compression memory 22. Reference numeral 21 
denotes a segment information table for storing segment information indicating divided areas of the compres- 
sion memory 22, i.e., storing the write addresses of compressed data. 

30 Reference numeral 22 denotes a compression memory, consisting of a plurality of small segments, for stor- 

ing compressed data output from the segment controller 20 at designated addresses. 

Reference numeral 23 denotes a block map memory for storing the signals 1h (1 bit per block) indicating 
pixel types in a block. 

Reference numeral 24 denotes a control section for controlling the operation timings of the above- 

35 mentioned respective sections (e.g., synchronous control of block signals). 

With the above arrangement, the divided ADCT-com pressed data and CG-compressed data are stored 
in the compression memory 22, and when the memory capacity runs short during compression processing, 
new compressed data are overwritten on data in the least important stage of ADCT-compressed data in turn 
with reference to the segment information table, thereby achieving a constant memory amount. 

40 Fig. 39 is a detailed block diagram of the pixel data replacing section 17. 

The pixel data replacing section 17 compares each pixel in the input pixel data group 1a from the raster- 
block conversion section 11 with predetermined pixel data a. When the two data coincide with each other, the 
section 17 replaces the corresponding pixel data with predetermined pixel data p. When the pixel type signal 
1b is '1\ the section 17 replaces the pixel with the pixel data a. 

45 With processing for replacing all pixels corresponding to the pixel type information = '1' (i.e., natural image 

pixels) with pixel data a, the CG-compressed data amount D of an image including both the pixel types A and 
B can be prevented from being increased, and at the same time, the pixel type information can be inserted in 
compressed data. For this reason, although a slight error occurs, le. % data of the pixel type B having the value 
of the pixel data a has the value of the pixel data p, such an error does not influence image quality. In this 

so embodiment, a = (127, 127, 127) and B = (128, 128, 128) are set. However, the present invention is not limited 
to these. 

Fig. 40 is a detailed block diagram of the reversible compression section 18. The basic arrangement in 
Fig. 40 is substantially the same as that in Fig. 28, except that four latches for storing color data and an area 
discrimination unit 1214 are arranged in Fig. 40. 
55 Reference numeral 1201 denotes an image data sorting unit for sorting pixel data from the pjxel data re- 

placing section 17 in an order shown in, e.g.. Fig. 41. 

Reference numeral 1202 denotes a first latch unit for holding pixel data (24 bits) from the image data sorting 
unit 1201 . Reference numerals 1203 to 1205 denote second to fourth latch units for holding pixel data (24 bits) 
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output from the first latch unit 1202. 

Reference numeral 1206 denotes a first comparison unit for comparing pixel data 2c from the image data 
sorting unit 1201 with pixel data held in the latch unit 1202, and outputting a signal 2a, which is '0' when the 
two data are equal to each other; which is 'V when the two data are different from each other. 

Reference numeral 1207 to 1209 denote second to fourth comparison units for respectively comparing pix- 
el data from the image data sorting unit 1201 with pixel data held in the second to fourth latch units 1203 to 
1205, and outputting '0* when the two data are equal to each other; 'V when the two data are different from 
each other. 

Reference numeral 1210 denotes a decoder for receiving the comparison results from the second, third, 
and fourth comparison units 1207, 1208, and 1209, and outputting a 2-bit signal 2b. Note that the signal 2b 
is W when the second comparison unit 1207 detects a coincidence; it is '01' when the third comparison unit 
1208 detects a coincidence; it is "10' when the fourth comparison unit 1209 detects a coincidence; and it 
is f ir when none of comparison units detect a coincidence. 

Reference numeral 1211 denotes a selector for selecting and outputting one of the comparison result 2a 
15 from the first comparison unit 1206, the signal 2b from the decoder 1210, and pixel data 2c output from the 
image data sorting unit 1201. 

Reference numeral 121 2 denotes a control unit for receiving the signals 2a and 2b, outputting write signals 
for the second, third, and fourth latch units 1203, 1204, and 1205, and controlling the selector 1211. If the re- 
lationship between the inputs 2a and 2b, and the write signals 2d, 2e t and 2f is expressed by "2a, 2b : 2d, 2e, 
20 2T, when "0, ** : 0. 0, 0", i.e., the signal 2a is '0\ none of the latch units are rewritten. When "1, 00 : 1 , 0, 0 a ] 
i.e., 2a = '1' and 2b ~ *0O\ the write signal 2d for the second latch unit 1203 is set to be '1'; when "1, 01 : 0, l! 
0", i.e., 2a = 'V and 2b = '01\ the write signal 2e for the third latch unit 1204 is set to be '1'; when "1,10: 0,' 
0, 1", i.e., 2a = T and 2b = "10\ the write signal 2f for the fourth latch unit 1205 is set to be T; and when 2a 
= 'V and 2b = 'H", the write signal 2f for the latch unit which holds the oldest color data is set to be"1\ 
25 Reference numeral 1213 denotes a backup unit for backing up the contents of the first to fourth latch unite 

1202 to 1205 before processing, and for, when the discrimination result indicates "area 2° after processing, 
restoring data before processing to the first to fourth latch units 1202 to 1205. 

Reference numeral 1214 denotes an area discrimination unit for receiving the signals 2a and 2b, and out- 
putting an area discrimination signal 1e (0: area 1, 1; area 2). 
30 When output pixel data are compressed by the reversible compression section 18 with the above- 

mentioned arrangement, the compressed data can be expanded without changing any bits. 
Fig. 42 is a detailed block diagram of the area discrimination unit 1214 shown in Fig. 40. 
Reference numeral 1301 denotes a counter for counting the number of times of the signal 2a = '1' (i.e., 
the number of color change points). Reference numeral 1302 denotes a counter for counting the number of 
times of the signal 2a = 'V and the signal 2b = '11* (i.e., the number of times of appearance of colors which 
are not held in any latch units). 

Reference numeral 1 303 denotes a multiplier for multiplying the output from the counter 1 301 with the num- 
ber of bits (2) of the signal 2b. Reference numeral 1 304 denotes a multiplier for multiplying the output from the 
counter 1302 with the number of bits (24) of the signal 2c. 

Reference numeral 1 305 denotes an adder for adding color change point information (64 bits) and the out- 
puts from the multipliers 1303 and 1304, and outputting the number of bits (compressed data amount) D finally 
required for the corresponding block. Reference numeral 1306 denotes an adder for adding the output from a 
buffer 1 307 and a remaining memory amount of the block (i.e., calculating a stock S as a total remaining mem- 
ory amount of processed blocks). Reference numeral 1 307 denotes a buffer for updating the output from the 
adder 1306 when a signal 3d is *1*. The signal 3d is T when a signal 3a is '0' (i.e., D ^L) and the signal 1d 
is 'V (Le„ a block includes at least one pixel having the pixel type B). 

Reference numeral 1 308 denotes a selectorfor selecting and outputting a constant value C when the signal 
1c from the pixel type information analysis section 15 is '0' or a constant value C when the signal 1c is T. 
Reference numeral 1 309 denotes a subtracter for subtracting the compressed data amount D as the output 
so from the adder 1305 from the output from the selector 1308. 

Reference numeral 1310 denotes a selector for selecting the output from the subtracter 1309 when the 
signal 3b = *0' or a constant (C - R) when 3b = T. ' 

Reference numeral 1 311 denotes an adder for adding the output from the subtracter 1309 and the stock 
S as the output from the buffer 1307. 
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Reference numeral 131 2 denotes a comparator for comparing the output from the adder 1311 with 0 and 
outputting a signal 3a = '0' representing "area 1" when the output from the adder 1311 is 0 or more, or a signal 
3a = T representing "area 2" when the output from the adder 1311 is less than 0. 

Reference numeral 1313 denotes a comparator for comparing the compressed data amount D from the 
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adder 1305 with 64, and outputting a signal 3b = '1* when a coincidence is found between the two data or a 
signal 3b = *0* when a non-coincidence is found between the two data. 

The area discrimination signal 1e is formed by logically ORing the signal 3a from the comparator 1312 
and the signal 3b from the comparator 1313. 

The limit value L (stock S + critical value C or C of the block) given to the block is compared with the com- 
pressed data amount D f and when D > L, the signal 1e = '1' is set to select ADCT compression so as to finally 
avoid overflow of a memory amount. When D = 64 (i.e., a flat image whose 64 pixel data have the same value), 
the signal 1e = T is set Even when a flat image is ADCT-compressed, deterioration is not conspicuous, and 
a high compression ratio can be obtained although color data slightly changes. In this case, when a flat image 
is formed for a reason other than that all pixels have the pixel type A, the stock S is added with a value C - 
R obtained by subtracting an experimentally determined compressed data amount upon ADCT compression 
of flat image from the constant value C. 

In other cases, the signal 1e = '0' is set, and the stock S is added with a value obtained by subtracting 
the compressed data amount D from the constant C or C. When all pixels in a block have the pixel type B, 
the constant C is selected; otherwise, the constant C is sejected. 

[Compression Processing Sequence] 

Data compression processing will be described below with reference to the flow charts shown in Figs. 43 
to 45. 

In the following description, assume that color data which is held in the first latch unit 1202 after the latest 
updating operation (to be referred to as "latest updating" hereinafter) is represented by "next", and color data 
which have been held in the second to fourth latch units 1203 to 1205 before latest updating are respectively 
represented by "former[0r, "former[1]". and "former^]". Also, assume that pixel data output from the image 
data sorting unit 1201 are represented by "present". These "next", "former[0-2]" f and "present" are data in the 
NTSC-RGB format, and have R, G, and B data, respectively. 

In this embodiment, a compression ratio of 1/10 is set as a target compression ratio, and a fixed value C 
given to one block is assumed to be (64 x 24)/10 » 153 bits. When a block includes pixels of both the pixel 
types A and B, the block must be subjected to ADCT compression processing simultaneously with CG com- 
pression processing. For this reason, the memory area for ADCT-compressed data amount must be taken into 
consideration. In addition, a compressed data amount experimentally set upon ADCT processing of a block 
whose 64 pixels have the same data (flat block) is represented by R. 

Fig. 43 is a flow chart showing a compression processing sequence of the data compression apparatus 

shown in Fig. 37. . 

In step S41, the stock S is reset to 128. The stock S is not reset to 0 so as to cope with a case wherein a 
plurality of new colors appear in the first block. That is, in the CG compression method of this embodiment, 
information representing color change points (steps S76 and S91) requires 64 bits per block, latch information 
(steps S96, S98, S100, and S102) at a color change point requires 2 bits, and when a new color, which is not 
held in any latch units, appears, 24 bits are required to directly output the color data (step S1 03). For this reason, 
appearance of a new color in a block requires (C - 64)/24, and when C = 153, (153 - 64)/24 * 3.7, and the 
number of new colors is limited to 3. Therefore, a certain stock S is initially required. 

In step S42, the four latch units of the reversible compression section 18 are reset. In this embodiment, 
assume that a normal image is a black image on a white background, and reset data for the latch units are set 
as follows: 

next = {255, 255, 255}, former[1] = {255. 0. 0), former[2] = {0, 0. 255} 

When the color of "present" does not coincide with color data in any latch units, "turn", "turn_p", and "turn- 
pp" as latch color data rewrite information are respectively reset to 0. 1, and 2 so as to rewrite the content of 
the latch unit, which holds the oldest color data. 

In step S43, the contents of the four latch units (next, former[0-2]) of the reversible compression section 
18 and the color data rewrite information (turn, turn_p, turn_pp) are saved as backup data. 

In step S44, 64-bit information in the bit map memory is referred to, and if 64 bits are all '1's (i.e., all natural 
image pixels), the flow advances to step S45; if 64 bits are all '0's (i.e., all pixels other than natural image pix- 
els), the flow advances to step S56; if 64 bits includes both '0's and 'Vs. the flow advances to step S47. 

In step S45, it is determined that the block is a natural image area, and a signal T representing "area 2" 
is output to the block map memory. 

In step S46, data for one block held by the delay section 12 are interpolated by the pixel data interpolation 
section 13, and the interpolated data are subjected to ADCT compression processing, thus outputting com- 
pressed data. 
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On the other hand, in step S47, data obtained by replacing data 1a for one block held by the raster-block 
conversion section 11 with reference to pixel type signals 1b are subjected to CG compression processing, 
compressed data are stored in the compressed data holding section 19, and the compressed data amount D 
at that time is calculated. 

5 In step S48, it is checked if the compressed data amount D is equal to or smaller than the limit value L (= 

stock S + f ixed value C'fora Mock including both the pixel types Aand B). If (C + S) i= D, "area 1 ° is determined, 
and the flow advances to step S49; if (C* + S) < D, w area 2" is determined, and the flow advances to step S53! 

In step S49, a signal f 0' representing "area 1° is output to the block map memory. In step S50, compressed 
data are output from the compressed data holding section 19.. In step S51, (C - D) is added to the stock S. In 

w step S52, the data for one block held by the delay section 12 are interpolated by the pixel data interpolation 
section 13, and the interpolated data are subjected to ADCT compression processing, thereby outputting com- 
pressed data. 

On the other hand, in step S53, a signal T representing "area 2" is output to the block map memory. In 
step S54, the data for one block held by the delay section 12 are interpolated by the pixel data interpolation 
15 section 1 3, and the interpolated data are subjected to ADCT compression processing, thereby outputting com- 
pressed data. In step S55, the corresponding backup data are substituted in the four latch units (next. former[0- 
2]) of the reversible compression section 18 and the latch rewrite information (turn, turn _p, turn jpp). More spe- 
cifically, information rewritten upon calculation of the CG-compressed data amount D of the block is restored 
to a state before processing of the block. 
20 On the other hand, in step S56, data obtained by replacing data 1a for one block held by the raster-block 

conversion section 11 with reference to pixel type signals 1b are subjected to CG compression processing, 
compressed data are stored in the compressed data holding section 19, and the compressed data amount D 
at that time is calculated. In step S57, the compressed data amount D is compared with 64. If a coincidence 
is found between the two values, the block is determined as a flat image and ADCT compression is efficient, 
25 and the flow advances to step S65; otherwise, the flow advances to step S58. ^ 

In step S58, it is checked if the compressed data amount D is equal to or smaller than the limit value L (= 
stock S + fixed value C). If (C + S) ^ D t "area 1" is determined, and the flow advances to step S59; if (C + S) 
< D, "area 2" is determined, and the flow advances to step S62. 

In step S59, a signal '0' representing "area 1" is output to the block map memory. In step S60, compressed 
30 data are output from the compressed data holding section 19. In step S61 , (C - D) is added to the stock S. 

On the other hand, in step S62, a signal 'V representing "area 2" is output to the block map memory. In 
step S63, the data for one block held by the delay section 12 are interpolated by the pixel data interpolation 
section 13, and the interpolated data are subjected to ADCT compression processing, thereby outputting com- 
pressed data. In step S64, the corresponding backup data are substituted in the four latch units (next, former[0- 
35 2]) of the reversible compression section 18 and the latch rewrite information (turn, turn _p, turn jp). More spe- 
cifically, information rewritten upon calculation of the CG-compressed data amount D of the block is restored 
to a state before processing of the block. 

On the other hand, in step S65, a signal '0' representing "area 1" is output to the block map memory. In 
step S66, (C - R) is added to the stock S. In step S67, the data for one block held by the delay section 12 are 
40 interpolated by the pixel data interpolation section 13, and the interpolated data are subjected to ADCT com- 
pression processing, thereby outputting compressed data. In step S68 f the corresponding backup data are 
substituted in the four latch units (next, fbrmeifO-2]) of the reversible compression section 18 and the latch 
rewrite information (turn, turn_p, turn_p). More specif ically, information rewritten upon calculation of the CG- 
compressed data amount D of the block is restored to a state before processing of the block. 
« Subsequently, it is checked in step S69 if all blocks are completed. If NO in step S69, the flow returns to 

step S43 to repeat the above-mentioned processing; otherwise, the processing is ended. 

The reversible compression section 18 (steps S47 and S56) will be described below with reference to the 
flow charts of Figs. 44 and 45. 

In step S71, "count2" for counting color change points, and n count3" for counting the number of times of 
so a case wherein data "present" is not held in any of the four latch units are reset to 0. In step S72. a counter i 
for counting 64 pixels in a block is reset to 0. In step S73, it is checked if a pixel type "bitmapO)'" at the i-th 
position of pixel type information 1 b is '0' (i.e., a computer-created pixel). If bitmap(i) = '()', the flow advances 
to step S74; if.bitmap(i) = T (natural image pixel), the flow advances to step S77. 

If it is determined in step S74 that a pixel corresponding to the i-th position from the raster-block conversion 
s section 11 coincides with color data a representing a natural image pixel (pix(i) = a{127, 127, 127)) the flow 
advances to step S75, and color data p = {128, 128, 128} is substituted in "present" representing the present 
color data. If a non-coincidence is found between the. two data, the flow advances to step S76, and a pixel 
value pix(i) at the i-th position from the raster-block conversion section 11 is substituted. 
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On the other hand, in step S77. it is determined that the pixel is a natural image pixel, and a - {127, 127, 
127} is substituted in "present". 

Subsequently, in step S78. it is checked if the present color data "present" coincides with the immediately 
preceding color data "next". If YES in step S78, the flow advances to step S79; otherwise, the flow advances 
5 to step S91 shown in Fig. 45. 

In step S79. it is determined that the color is left unchanged, and '0' is output to the control unit 1212. In 
step S80, "present" is substituted in "next". In step S81 . the counter i is incremented. In step S82, it is checked 
if i ^ 64. i.e., non-processed pixels remain. If such pixels remain, the flow returns to step S73; if i > 64, it is 
determined that all pixels are completed, and the flow advances to step S83. 
w in step S83, the compressed data amount D of the block is calculated, and the processing is ended. Note 

that the compressed data amount D can be calculated by: 

D = 64 + 2xcount2 + 24 x count3 
Fig. 45 shows processing executed when it is determined in step S78 that "present" does not coincide with 
"next", i.e., the color is changed. 
15 In step S91, it is determined that the color is changed, and T is output to the control unit 1212. In step 

S92 "count2 B is incremented. In step S93, it is checked if the number "turn" representing the latch unit updated 
latest is equal to the number "turn_p" representing the latch unit updated previously. If the two values are equal 
to each other, the flow jumps to step S95; otherwise, the flow advances to step S94. In step S94, "turn_p" is 
substituted in "turn _pp\ and "turn" is substituted in "turn_p". This processing is to prevent "turn" and "turn_p" 

20 from having the same value. 

In step S95, the present value "present" is compared with the contents of the second to fourth latch units 
1203 to 1205 (former[0-2]). If present = former[0], the flow advances to step S96; if present = former[1], the 
flow advances to step S98; if present = former[2], the flow advances to step S100; if "present" is equal to none 
of • , formeit0-2]", the flow advances to step S1 02. 
25 In step S96, it is determined that the present value is equal to the content of the second latch unit.1203, 

and -00' is output to the control unit 1212. In step S97, a number, '0'. of the second latch unit 1 203 is substituted 
in "turn" as a latch number to be rewritten. 

In step S98, it is determined that the present value is equal to the content of the third latch unit 1204, 
and '01' is output to the control unit 121Z In step S99. a number, '1 \ of the third latch unit 1204 is substituted 
30 in "turn" as a latch number to be rewritten. 

In step S100 it is determined that the present value is equal to the content of the fourth latch unit 1205, 
and '10' is output to the control unit 1212. In step S101 , a number, '2', of the fourth latch unit 1205 is substituted 
in "turn" as a latch number to be rewritten. 

In step S102, it is determined that the present value is different from any latch units, and '11' is output to 
35 the control unit 1212. In step S103, the present value "present" is output. In step S104, the counter "count3" 
for counting a case wherein "present" is different from all of the first to fourth latch units 1202 to 1205 is in- 
cremented. In step S1 05, a latch number j different from "turn_p" and "turn_pp" are searched, and the searched 
j is substituted in "turn". This processing is to present "turn_p" and "turn_pp" from having the same value in 
steps S93 and S94, and one of the latch numbers, 0, 1 , or 2, is searched in this case. 
40 Subsequently, "next" is substituted in «former[next]" in step S106, and the flow returns to step S80 shown 

in Fig. 44. 

Pmage Data Expansion Apparatus] 

45 Fig. 46 is a block diagram of an image expansion apparatus for expanding image data compressed by the 

above-mentioned processing. A r»^x 

A segment controller 20 distributes compressed data stored in a compression memory 22 to an ADCT ex- 
pansion section 31 and a reversible expansion section 33 with reference to a segment information table 21. 
Reference numeral 31 denotes an ADCT expansion section for expanding and outputting ADCT- 
50 compressed data. Reference numeral 32 denotes a buffer for temporarily holding image data expanded by the 
ADCT expansion section 31. 

Reference numeral 33 denotes a reversible expansion section for expanding and outputting CG-com- 
pressed data. Reference numeral 34 denotes a buffer for temporarily holding image data expanded by the re- 
versible expansion section 33. . 
55 Reference numeral 35 denotes a bit map memory for storing data obtained by logically ORing 1-bit infor- 

mation 11 a from a block map memory 23 and pixel type information 1 1 b analyzed by the reversible expansion 
section 33. 

Reference numeral 36 denotes a selector for selecting and outputting one of the output from the buffer 32 
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and the output from the buffer 34 in units of pixels in accordance with a signal 11c from the bit map memory 

Reference numeral 37 denotes a block-raster conversion section for storing image data selected by the 
selector 36, and forming a synthesized image. 

[Expansion Processing Sequence] 

Fig. 47 is a flow chart showing expansion processing. 

In step S1401, •next" and formeifO-2]" (the contents of the first to fourth latch units 1202 to 1205) are 
reset to the same values as those in the compression processing. At the same time, the latch rewrite numbers 
are also reset to the same values as those in the compression processing. In addition, 0 is set in "bitmap[-1 J" 
as bit map information of the last pixel in a previously processed block. 

In step S1402, area information of the block is read out from the block map memory 23. and is substituted 
in "mapdata". In step S1403. it is analyzed if "mapdata" is '0' ("area 1") or'1 ' ("area 2"). If "area 1 ■ is determined 
the flow advances to step S1404; if "area 2" is determined, the flow advances to step S1 409. ' 

In step S1404, since "area 1" is determined. CG-compressed data are received from the compression 
memory 22 under the control of the segment controller 20, the compressed data are expanded, and expanded 
data are output In addition, pixel type information 11b is analyzed, and is written in the bit map memory 35 
In step S1405, pixel data CG_DATA obtained by expanding the CG-compressed data are written in a storage 
section (raster-block conversion section 37). 

In step S1406, it is checked if the content of the bit map memory 35 includes at least one T. If YES in 
step S1406, the flow advances to step S1407; otherwise, the flow advances to step S1411. 

If the content of the bit map memory 35 Includes at least one '1', since the block is constituted by data 
obtained by CG-compressing replaced pixel data, and data obtained by ADCT-com pressing interpolated pixel 
data, ADCT-compressed data are received from the compression memory 22 under the cidhtrbl of the segment 
controller 20. and are ADCT-expanded in step S1407. In step S1408. pixel data ADCT.DATA obtained by ex- 
panding the ADCT-compressed data are overwritten at pixel positions, corresponding to value '1' on the bit 
map memory 35. on the storage section (block-raster conversion section 37). 

In this manner, pixel data CG_D ATA obtained by expanding CG-compressed data in step S1404 are written 
at pixel positions, corresponding to value '0' on the bit map memory 35, on the block-raster conversion section 
37, and pixel data ADCT_DATA obtained by expanding ADCT-compressed data in step S1407 are written at 
pixel positions, corresponding to value *T on the bit map memory 35. on the block-raster conversion section 

On the other hand, in step S1409, "area 2" is determined. ADCT-compressed data are received from the 
compression memory 22 under the control of the segment controller 20, the compressed data are ADCT- 
expanded. and expanded image data are output Instep S1410, pixel data ADCT_DATA obtained by expanding 
the ADCTcompressed data are written in the storage section (block-raster conversion section 37) 

Subsequently, in step S1411. it is checked if all compressed data are expanded. If non-processed com- 
pressed data remain, the flow returns to step S1402; otherwise, the processing is ended. 

Fig. 48 is a flow chart showing processing of the reversible expansion section 33 (step S1404). 

In step S1501 . a counter i for counting the number of pixels is reset to 0. In step S1 502. 1-bit data (bit map 
™'!! a .i ,0n) ' S received from the compressed memory 22. and is substituted in "datal". It is checked in step 
S1503 rf datal = '0\ If datal = '0\ the flow advances to step S1504; if datal = '1\ the flow advances to step 

In step S1504. the value of bit map information "bitmap[M]" of the immediately preceding pixel i-1 is 
H bitmap[MJ = v ' '°' fe substituted in bit map information "bitmapP]" of a pixel of interest in step 
S1506; rf brtmapD-1] = '1'. T is substituted in "bitmapH" in step S1505. and thereafter, the flow advances to 
step S1521. Note that the same result can be obtained even when the value of "bitmap[i-i]" is substituted in 
bit map information "bitmapp]" of the pixel of interest in step S1504. 

In step S1507, it is checked if a latch number "turn" rewritten latest is equal to a latch number "turn p" 
rewritten previously. If the two values are equal to each other, the flow jumps to step S1508; otherwise 
"turn_p" is substituted in "turn_pp", and "turn" is substituted in "turn _p" in step S1507'. This processing is to 
prevent "turn" and "turn_p" from having the same value, and is also executed in the compression processing 

In step S1508. 2-bit data from the compression memory 22 is substituted in "data2", and in step S1509 
™^ analy2ed - ' f data2 = '° 0 '' 0 is subsfitute d in "turn" to output a pixel stored in "formerfO]" (second latch 
un.U203) in step S1510; if data2 = W, 1 is substituted in "turn" to output a pixel stored in "formerfll" (third 
atclvun.t 1204) in step S1511; if data2 = '10", 2 is substituted in "turn" to output a pixel stored in former[2r 
(fourth latch unit 1205) in step S1512. Thereafter, the flow advances to step S1513. If data2 = '11 1 , the flow 
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advances to step S1 51 5. ^ _ 

In step S1513, pixel data in "next" (first latch unit 1202) and pixel data in formertfum] are exchanged with 
each other, and in step S1514, '0' is substituted in n bitmap[fl°. 

On the other hand, if a pixel to be output is present in none of -next" and "formerlO^r. a latch number j 
5 different from w turn_p" and "turn _pp a is searched in step S1515. Since the processing for preventing "turn_p" 
and °turn __pp w from having the same value is executed in steps S1507 and S1507\ one of the latch numbers, 
0 1 or 2 is selected in this case. The searched latch number j is substituted in "turn tt . 

'in step S1516, "next" is substituted in "former[turn]-. In step S1517, 24-bit data (pixel data) is received from 
the compression memory 22, and is substituted in "next". If it is determined in step S1518 that the value of 
10 "next" is a ({127. 127, 127}), the flow advances to step S1519; otherwise, the flow advances to step S1520. 
In step S1519, T is substituted in "bitmapp]"; in step S1520. , 0' is substituted in "bitmap [i] n . 

Subsequently, with the above-mentioned processing (steps S1 502 to S1520), since pixel data to be output 
is stored in "next" in any case, the pixel data stored in "next" is output in step S1521. 

In step S1522, the counter i is incremented. It is checked in step S1523 if processing of 64 pixels is com- 
15 pleted. If NO in step S1523, the flow returns to step S1502; otherwise, the flow advances to step S1524. 

In step S1524, "bitmap[63] M is substituted in tt bitmap[-1] w . This step is executed for the processing of the 
next processing, and thereafter, the processing is ended. 

[ADCT Compression] 

20 

The ADCT section 1 4, the ADCT expansion section 31 , the segment controller 20, the segment information 
table 21 and the compression memory 22 will be described in detail hereinafter. 

As has been described previously in the paragraphs of the prior arts, ADCT compression allows adjustment 
of the data amount after compression. For this purpose, compression is executed by performing a pre-scan 
25 operation, parameters for compression are re-set on the basis of the compressed data amount, re-compression 
is executed, and such operations must be repeated. Thus, since a target compressed data amount is achieved 
in a try-and-error manner, a very long time is required until the end of compression; 

Thus, in this embodiment, the above-mentioned problem is solved as follows. 

Fig. 49 is a block diagram showing the detailed arrangement of the ADCT section 14 shown in Fig. 37. 
30 Compression processing of image data will be described below with reference to Fig. 49. 

In a color conversion unit 501, input RGB image data is converted into Y, u, and v components using 3 x 
3 linear matrix conversion given by the following equation: 
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where Y is the luminance component, and u and v are the chromaticity components. 

A sub sampling unit 502 performs sub sampling to decrease chromaticity data by utilizing the nature that 
the sensitivity characteristics of human eyes are more sensitive to the luminance component (Y) than the chro- 
maticity components (u, v). For example, image data is converted into Y : u : v = 4 : 4 : 4 (without sub sampling), 
45 Y : u : v = 4 : 2 : 2, orY : u : v = 4 : 1: 1. 

The outputs from the sub sampling unit 502 are output in units of 8 x 8 blocks in the order of Y1, u1, v1, 
Y2 u2 v2 in the case of Y : u : v = 4 : 4 : 4, in the order of Y1 , Y2, u1 . v1 . Y3, Y4. u2, v2,... in the case of 
Y :'u : v = 4 : 2 : 2, or in the order of Y1 , Y2, Y3, Y4, u1 , v1, Y5, Y6, Y7, Y8, u2, v2, ... in the case of Y : u : v 
= 4:1:1. 

so A DCT unit 503 DCT-transforms data output from the sub sampling unit 502 in units of 8 x 8 blocks, and 

outputs DCT coefficients. 

A quantization unit 504 quantizes DCT coefficients output from the DCT unit 503 in units of 8 x 8 blocks 
using a quantization table 508, thus obtaining quantized coefficients. 

8x8 two-dimensional quantized coeff icients are one-dimensionally sorted in the orderfrom a low-frequen- 
55 cy component to a high-frequency component by zigzag scan, as shown in Fig. 21 , and the sorted coefficients 
are supplied to an adaptive Huffman encoding unit 505. 

As will be described in detail later, the adaptive Huffman encoding unit 505 performs conversion in units 
of 64 one-dimensional data, and outputs the encoded data, bit sizes, and stage numbers. In this embodiment, 
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four stages are prepared. 

The segment controller 20 writes data in the compression memory 22 divided into segments in units of 
stages in accordance with the encoded data, bit sizes, and stage numbers output from the adaptive Huffman 
encoding unit 505. In addition, the controller 20 writes segment distribution information indicating write seg- 
ments and stages of data in the segment information table 21. This information is used in expansion. 

When the segments for storing data distributed in units of stages are controlled by the segment controller 
20, fixed-length compression can be realized. This will be briefly described below. That is, data distributed to 
respective stages can be controlled to a target data amount by selecting the stages to be adopted, i.e., com- 
pressed data of only the first and second stages, or compressed data of only the first, second, and third stages, 
or all compressed data of the first, second, third, and fourth stages in accordance with the storage capacity 
of the compression memory 22 or the total compressed data amount of an image to be compressed. For ex- 
ample, if data of the first stage has 2.5 MB, data of the second stage has 1.5 MB, data of the third stage has 
0.8 MB, data of the fourth stage has 0.5 MB, and the target data amount is 5.0 MB, a total compressed data 
amount of 4.8 MB is achieved by using the data of the three stages, i.e., the first, second, and third stages, 
and can be controlled to be equal to or smaller than the target data amount. Therefore, distribution of all en- 
coded data in units of stages influences the precision of fixed-length compression. 

The segment controller 20, the compression memory 22, and the segment information table 21 will be de- 
scribed in detail later. 

The adaptive Huffman encoding unit shown in Fig. 50 will be briefly described below, and thereafter, the 
respective blocks wBI be described in detail. 

The adaptive Huffman encoding unit shown in Fig. 50 outputs the encoded data, bit sizes, and stage num- 
bers. That is, when the target bit rate (the bit rate is a unit representing a compression ratio, and is expressed 
by the number of bits per pixel [bits/pixel]) of the entire image is assumed to be 2.4 [bits/pixel], the target bit 
rate of the first stage is set to be 1.5 [bits/pixel] in an 8 x 8 block. Since the remaining number of stages is 
three (i.e., the second, third, and fourth stages), the remaining number of bits (2.4 - 1 .5 = 0.9) in the block are 
substantially equally divided into three stages, and the divided bits are distributed to the second, third, and 
fourth stages. 

Referring to Fig. 50, an adaptive Huffman encoder 514 Huffman-encodes one-dimensionally sorted quan- 
tized coefficients in units of 64 coefficients (in units of Y, u, and v components of an 8 x 8 block), and outputs 
encoded data, a bit size, and a block end signal indicating a division of a block. 

A buffer memory 51 5 stores these data in the format shown in Fig. 51 . Referring to Fig. 51 , an index is a 
serial number of output encoded data in a single block, and the number of effective bits of encoded data is 
designated by a bit size. A bit size sum value is obtained from a bit size adder 517. 

The bit size adder 517 starts addition of bit sizes of AC components in units of blocks in response to the 
block end signal, and outputs the sum value to a comparator51 8. The comparator 51 8 compares the sum value 
with threshold tables 519 (see Fig. 52) prepared in units of Y, u, and v components. When the sum value ex- 
ceeds a threshold value, the comparator 518 outputs an index before the sum vaiue exceeds the threshold 
value, and resets the bit size adder 517 to restart addition from the bit size which has exceeded the threshold 
value. When the bit size adder 51 7 detects the end of a block in accordance with the block end signal, it supplies 
the final vaiue to a reference value calculator 516. The reference value calculator 516 calculates a plurality of 
bit size sum reference values on the basis of the final bit size sum value. 

These operations will be described in detail below with reference to Figs. 51 and 52. Since the target bit 
rate of the first stage is set to be 1.5 [bits/pixel], the numbers of bite of Y, u, and v components are respectively 
set to be 40, 28, and 28 [bits] in Fig. 52 so as to realize this bit rate. 

Fig. 51 shows encoded data, bit sizes, and bit size sum values of Y components in a certain 8x8 block 
The bit size of index 0 is not added since index 0 corresponds to a DC component, and the bit size is written 
in the bit size sum value from the first bit size '18* of an AC component of index 1. Since the bit size of index 
2 is T, the bit size sum value of index 2 becomes 25 (= 1 8 + 7), and the bit size sum value of index 3 becomes 
39 (= 25 + 14). 

Since the bit size of index 4 is '22\ the bit size sum value becomes 61 . In this case, since the comparator 
518 determines that the bit size sum value exceeds the value (40 [bits]) of the Y-component threshold value 
table 519, index 3 immediately before index 4 is supplied to a stage discriminator 520. The bit size adder 517 ' 
is reset, and the bit size '22' of index 4 is directly written in the bit size sum vaiue. 

Since the bit size of index 5 is '9', the bit size sum value becomes 31 (= 22 + 9). 

Similarly, the bit sizes are added, and are written in the bit size sum value until the corresponding block 
ends. The final bit size sum value '95' is transferred to the reference value calculator 516, and the reference 
value calculator 516 divides '95' with 3 since three stages remain. Thus, a value '30', and a value '60' twice 
the value '30' are supplied to the stage discriminator 520 as bit size sum reference values. 
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The stage discriminator 520 determines stages, to which encoded data and bit sizes are distributed, on 
the basis of the index obtained from the comparator 518, and the bit size sum reference values obtained from 
trie reference value calculator 516. 

As described above, the obtained data are index 3, and the bit size reference values 30 and 60 . The 
5 buffer memory 515 counts the input bit size sum values, and outputs stage number #1 for data up to index 3. 
Then as for the following data, the bit size sum value is compared with the bit size sum reference value -30'. 
and when the bit size sum value is equal to or larger than 0 and equal to or smaller than 30. stage number #2 
is output- when the bit size sum value is equal to or larger than 31 and equal toorsmallerthan 60. stage number 
#3 is output; when the bit size sum value is larger than 60, stage number #4 is output. At the division of each 
io stage an EOS (End of Stage) code indicating the division of the stage is inserted. 

Thus, each of different encoded amounts in units of 8 x 8 blocks is distributed to the first stage at the bit 
rate of about 1.5 [bits/pixel], and the remaining data can be equally divided into three stages. 

In the above-mentioned example, the bit size sum value of an 8 x 8 block exceeds 40. However, if the bit 
sum value does not exceed 40. an EOB (End of Block) code is inserted, and all encoded data of the 8 x 8 block 
ts are written in the segment of the first stage. 

[ADCT Expansion] 

Expansion of data compressed by the above-mentioned compression process will be described below. 

20 The arrangement of the ADCT expansion section 31 is substantially the same as that of the ADCT section 

14 shown in Fig. 49 although the data flow is reversed to that in the compression process. Therefore, the DCT 
unit 503 in Fig. 49 is replaced with an inverse DCT unit 503. the quantization unit 504 is replaced with an inverse 
quantization unit 504. and the adaptive Huffman encoding unit 505 is replaced with an adaptive Huffman de- 
coding unit 505. Also, the quantization table 508 and the Huffman table 509 are respectively replaced. with an 

25 inverse quantization table 508 and a Huffman decoding table 509. 

Since encoded data constituting a single 8x8 block are stored in the compression memory 22 while be.ng 
divided into a plurality of stages, the adaptive Huffman decoding unit 505 receives and decodes encoded data 
from the plurality of stages to re-constitute the single 8x8 block. 

For this purpose, the adaptive Huffman decoding unit 505 requests encoded data of stage number #1 to 

so the segment controller 20. The segment controller 20 reads the encoded data of the first stage from the com- 
pression memory 22 with reference to the content of the segment information table 21. and transfers the read 
data to the adaptive Huffman decoding unit 505. The adaptive Huffman decoding unit 505 sequentially decodes 
transferred encoded data, and transfers decoded results to the inverse quantization unit 504 until it detects an 
EOS code. Upon detection of an EOS code, the decoding unit 505 requests encoded data of stage number 

35 #2. , . „„ ... 

The segment controller 20 reads encoded data of stage number#2 from the compression memory 22 with 
reference to the content of the segment information table 21 . and transfers the read data to the adaptive Huff- 
man decoding unit 505. The adaptive Huffman decoding unit 505 performs decoding until it detects another 
EOS code in the same manner as described above. 
40 The decoding unit 505 similarly decodes data of the third and fourth stages, thus completing encoding of 

a single 8x8 block If the decoding unit 505 detects an EOB code during decoding of a certain stage, it does 
not request encoded data of the next stage, and starts decoding of the next 8x8 block. When compressed 
data are not stored up to its final stage due to too large a compressed data amount or a short capacity of the 
compression memory 22, the decoder performs expansion using data up to intermediate stages. 
45 Quantized coefficients obtained in this manner are inversely quantized by the inverse quantization unit 

504 using the inverse quantization table 508. and are supplied to the inverse DCT unit 503. 

The inverse DCT unit 503 inversely DCT-transforms obtained DCT coefficients to obtain Y\ u\ and v' data. 
The sub sampling unit 502 performs an enlargement operation according to a sub sampling ratio (Y : u : 

v = 4 : 4:4,4:2: 2, or 4: 1 : 1) . 
so The color conversion unit 501 performs inverse conversion using the following equation, thus reproducing 

an original image: 
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[Multi-Stage Storage] 

Storage of compressed data divided into multiple stages in compression/expansion processing of image 
data, storage of data compressed by the reversible compression section 18 to the compression memory 22 
constituted by a plurality of segments, and storage of selected segment information in the segment information 
table 11 will be described in detail below. Note that data compressed by the reversible compression section 
18 is processed as one of compressed data divided into multiple stages, and is processed as data of the first 
stage since necessity of preservation of information is high. 

= 1 oocytes) F ' 9 COmpression memor y 22 is divide d '"to segments S-1 to S-N (e.g.. one segment 

The segment information table 21 has an architecture shown in Fig. 54. The first to fourth rows of the seg- 
ment information table 21 store information associated with the first to fourth stages. In the first column 1- 
bit data representing if the corresponding stage is effective or ineffective is stored, and T indicates that the 
corresponding stage is effective; *0' indicates that the corresponding stage is ineffective. In the second and 
subsequent columns, the selected segment numbers (S-1 to S-N) of the compression memory 22 in which 
encoded data of the respective stages are written are stored. The left end of these columns corresponds to 
the head of an image, and the right end of these columns corresponds to the end of an image. "END" indicates 
the end of encoded data in each stage. 

A sequence for writing encoded data in the compression memory 22 in units of stages wOl be described 
below. 

Note that the compressed data amounts distributed to the respective stages vary depending on a com- 
pression method for distributing data to the stages or the characteristics of original image data. A case will be 
exemplified below where the output compressed data amount of the first stage is larger than that in the fourth 
stage upon comparison of the first to fourth stages. 

Encoded data storage processing will be described below with reference to the flow chart of encoded data 
storage processing in compression processing shown in Fig. 55, and the segment information table shown in 
Fig. 54. 

As shown in the second column (column No. 2) in Fig. 54. encoded data output in the respective stages 
begin to be wntten in the segments S-1 . S-2, S-3. and S-4, respectively (step S1). 

In the first stage 1 , since the segment S-1 becomes full of data earlier than other stages, data begins to 
be written in the segment S-5 (steps S2 and S3). 

In the second and third stages, since the segments S-2 and S-3 become full of data, data begin to be written 
in the segments S-5 and S-6 (steps S2 and S3). 

Since encoded data of the first stage f ill the segment S-5 before the segment S-4 becomes full of encoded 
data of the fourth stage, an empty segment S-8 is assigned not to the fourth stage but to the first stage (steps 
S2 and S3). Such a phenomenon occurs since the code amount generated in the first stage is larger than that 
generated in the fourth stage. 

Similarly, when a segment in which data are written becomes full of data in each stage, an empty segment 
is selected, and encoded data is written in the selected segment (steps S2. S3, and S4). 

In this embodiment, a method of encoding an original image while dividing it into some stages is used 
Thus, when the code amount of each stage is smaller than the target compressed data amount, no ineffective 
stage appears. However, when the target amount is reached during encoding, a designated stage is made in- 
effective (thefourth stage in Fig. 54). and encoded data of the remaining first, second, orthird stage are written 
in the segments S-4, S-11, S-15.... assigned to the designated stage (step S5)l 

The eighth to 11th columns (Nos. 8to 11) in Fig. 54 correspond to the above description. Since the segment 
S-N is assigned in the second stage of the eighth column, this means that all the segments of the compression 
memory 22 have been assigned, and the fourth stage is made ineffective ('0') so as to compensate for the 
shortage of the compression memory. As shown in the ninth column, the segment S-4 used in the fourth stage 
is assigned to the first stage, and the segment S-11 is assigned to the second stage. Since the encoded data 
of the second stage are ended when they are written in the segment S-11, an END mark is stored in the 10th 
column, as shown in Fig. 54. 

Since the encoded data of the first stage are ended when they are written in the segment S-15 of the 10th 
column, an END mark is stored in the 11th column. 

When the compressed data stored in the compression memory 22 are expanded, image data is decoded 
using only the effective stages (the first to third stages in Fig. 54). 

In this manner, with the compression/expansion processing, compression can be performed without losinq 
any data in CG compression, and when the CG-compressed data amount exceeds the limit value L = (C + S) 
g.ven to the block, the ADCT compression processing is performed, so that the final memory amount can be 
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maintained to be equal to or smaller than a predetermined amount, and image quality can be preserved. As 
for a block including different pixel types, which poses problems associated with image quality and the com- 
pression ratio in the conventional method, both the ADCT compression and CG compression are performed. 
That is in the ADCT compression processing, image quality is preserved by inputting interpolated data, and 
in the CG compression processing, the compression ratio is maintained by inputting replaced data. Further- 
more, since pixel type information in units of pixels of a block including different pixel types can be inserted 
in CG-compressed data, no extra bit map memory is required. 

According to the above-mentioned multi-stage storage method, memory management can be easily per- 
formed according to the importance of image data, and since both ADCT-compressed data and CG-com- 
pressed data are processed in a single memory space, address control in a read-out mode and synchronous 
control in a write mode can be facilitated. 

[Modification of Fifth Embodiment] 

In the fifth embodiment described above, the signals 2a. 2b. and 2c can be stored at different addresses. 
In this case, these signals are stored at different addresses by the segment controller 21. 

In the fifth embodiment described above. CG-compressed data (signals 2a and 2b) stored in the com- 
pressed data holding section 19 are constituted by a flag system indicating ON/OFF ('07T). However, these 
signals may be constituted by a trigger system. 

As shown in Figs. 13A and 13B, identical data tend to continue for a longer period in the trigger system 
than in the flag system; By utilizing this nature, the signals 2a and 2b may be subjected to another run length 
compression such as MH to decrease the data amount. 

The present invention is not limited to MH. For example, completed compressed data may be subjected 
to Huffman encoding or Lempel-ziv encoding to be further compressed. Note that it is also effective to perform 
Huffman encoding or Lempel-Ziv encoding of the signal 2c. 

In the reversible compression section 18 of the above-mentioned fifth embodiment, the present value 
"present" to be output in step S103 may be stored as a look-up table. 

A computer-created image created by, e.g.. DTP has a feature of a small number of used colors, and most 
of images can be expressed by 256 colors. Also, an 8-bit (256 colors) memory may be prepared as a table, 
and when the 256th color appears, 24-bit data may be directly output. Thus, the number of expressible colors 
is not limited, and since most of color data can be expressed by 8 bits in place of 24-bit data required in the 
above system, the compression ratio can be increased. Therefore, the number of blocks to be subjected to 
CG compression processing is increased as compared to the fifth embodiment, and image quality can be im- 

Pr ° V |n d the reversible compression section 18 of the fifth embodiment described above, the number of latch 
units (former) for storing previous pixel data is 3. but may be decreased to 1. In this case, a signal corresponding 
to steps S96 S98 S100. and S102 becomes a 1-bit signal, and since the number of latch units to be written 
(in which "next" is substituted) is 1 , processing such as "turn" indicating the order of rewriting is unnecessary. 
In this case, an equation for calculating the compressed data amount is rewritten as follows: 
D = 64 + 1 x count2 + 24 x count3 

In the reversible compression section 1 8 of the fifth embodiment described above, the present value "pres- 
ent" to be output in step S1 03 may be, e.g.. 18-bit data in place of 24-bit data. In this case, although expanded 
data has a different value from that of original image data, and reversible compression is disabled, since a high- 
frequency image such as a computer-created image does not require too good gradation characteristics for 
human eyes, deterioration of image quality is not conspicuous, and the compressed data amount is decreased 
as in the following equation: 

D = 64 + 2xcount2 + 18xcount3 

In the reversible compression section 1 8 of the f ifth embodiment described above, latch rewnte informa- 
tion (turn turn_p, turn_pp) may be omitted, and a latch unit to be rewritten when the same color is not present 
in any latch unit may be permanently determined. For example, when the signal 2a is '1', and the signal 2b 
is '1T, a latch unit to be rewritten is permanently determined as the second latch unit 1203. In this case, al- 
though compression efficiency is slightly impaired, the hardware scale can be reduced. 

In the reversible compression section 1 8 of the fifth embodiment described above, the buffer 1 307 for stor- 
ing the stock S is arranged, and the limit value L of a block to be processed is def ined by C + S. However. L 

= C may be used. . . . 

In the fifth embodiment described above, the segment controller 20 is used in memory control, and com- 
pression is performed in a reai-time manner. Alternatively, pre-scan (pre-development) may be performed to 
determine a 8-factorof ADCT compression in advance, and then, compression may be performed. In this case. 
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memory control can be further facilitated. 

• reversible compression section 18 in the fifth embodiment described above, the image data sortinq 
unit 1201 adopts a zigzag order shown in Fig. 41. However, the present invention is not limited to this If the 
sorting order at this time is determined in correspondence with an order of data sent from the raster-block 

s conversion section 11, the function of the image data sorting unit 1201 can be omitted 

In the fifth embodiment described above, the pixel data replacing section 17 replaces values of pixels hav- 
ing the pixel type A to reduce the compressed data amount of the reversible compression section 18 and to 
realize msertion of bit map data. However, instead of replacing pixel data, a reversible compressed code rep- 
resenting the pixel type Amay be determined in advance, and the code may be output in correspondence with 

10 the pixel type A. 

For example, three latch units may be used in place of the four latch units in the fifth embodiment, and a 
code corresponding to the pixel type A (a code upon detection of a coincidence with the fourth latch unit 1205) 
may be se to be 110'. Thereafter, when pixels of the pixel type A continue. '0' is similarly output When a pixe 

« J M- T IT f.T^* ' 1 ' fe OUtpUt ' and the co,or of the pixel te ^P^d with the contents of the second 
is and third latch units 1203 and 1204 to output a code. In this case, if the color of the pixel does not coincide 
with the contents of the second and third latch units 1203 and 1204 fur is output), updating processing by 
updating means is not performed. That is. upon switching from the pixel type A to the pixel type B the 
code 0 indicating that input data is the same as data in the first latch unit 1202 becomes a code representing 
5™ S^SL ^ eaSOn '. * the inPUt d3ta iS com P ared with data in the second and third latch unite 

»S f . r 1 ^ ™ ' S determ,ned that the in P ut data coincides with neither of the data in the second and 

^TSi™ .h „ 204 (piXe ' d3ta ' S ° UlpUt) 10 rewrite data ,n one of the second a " d third latch units 
1203 and 1204 with data in the first latch unit 1202. the same data may be undesirably stored in the three 
latch units when input pixel data coincides with data in the first latch unit 1202. 

In the fifth embodiment described above, the compression method is realized by hardware but may be 
25 realized by software. . 

[Sixth Embodiment] 

A case will be described below wherein the first example of an adaptive Huffman encoding unit based on 
indices shown in Fig. 57 is used as the adaptive Huffman encoding unit 505 shown in Fig 49 

A Huffman encoder 521: Huffman-encodes one-dimensionally sorted quantized coefficients in units of 64 
coefficients fir. u and v components of an 8 x 8 block), and outputs encoded data, bit sizes, and a block end 
signal indicating the division of a block. 

A buffer memory 522 stores these data in the format shown in Fig. 58. Referring to Fig. 58, an index is a 
serial number of output encoded data in a single block, and the number of effective bits of encoded data is 
designated by a bit size. 

9nri t!H! S i Ze t h dder525 1 addS bitsizes of AC components in units of blocks in response to the block end signal, 
and outputs the sum value to a comparator 526. 

The comparator 526 compares the sum value with threshold value tables 527 (see Fig. 52) prepared in 
T ThV ndv h Compone i nte - When thes ™ value exceedsthethresho.d value, the comparator 526outputs 
Limin^S 6 , fK SUm va,u ° exceeds the thresh °' d value as a basic index to a counter 523 and a stage dis- 
stage" 0386 9S " K 3nd 58 ' SinC6 b3S|C indGX ° f Ybecomes 3 - ind ices 0 to 3 are written 

x 8 J^T^ff T^, ^ th6 input Sl ' 9nal ° f the bit size of the f irst AC component of an 8 
x 8 block. Upon detection of one block based on the block end signal, the counter 523 calculates a reference 
ndex on the bas.s of the final index and the basic index obtained from the comparator 526. and ouSuts^e 

and^r fnn e ,fH 9 ! diSC r inat ° r 524 " the 6Xamp,e Shown in R 9- 58 ' since the basic index is 3 
SJS h T ^ in tNe ?eC ° nd and stages are indices 4 to 18. Therefore, in 

1Tb JaT ?, « 4 ? subsequent indices into ««. ^es, 18 - 3 = 1 5 is divided into three stages" 
and 8 (- 3 + 5) and 1 3 (= 8 + 5) are output as the reference indices. 

^ Also, the block end signal from the Huffman encoder 521 resets the bit size adder 525 and the comparator 

522 S discriminator 5 ^ counts indices based on the bit size signals supplied from the buffer memory 

S^sSSLV^ T b V" t , he . baS ' S ° f the C ° Unt Va,Ue ' the ° btained basic inde * a " d «» 
n,!^;! , h ! > T ,S 3 ' the referenCe indiC6S are 8 and 13 ' the discriminator 524 outputs stage 
number#1 for data up to mdex 3 in Fig. 58; stage number#2 for data from indices 4 to 8; stage number#3 for 
data from mdices 9 to 13; and stage number #4 for the following data until this block ends. In this case when 
the stage number ,s changed, an EOS code required in expansion is inserted. 

32 



35 



40 



45 



0S831O7A2..I. 



EP 0 583 107 A2 



The adaptive Huffman decoding unit 505 for expanding encoded data encoded by the above-mentioned 
method can be realized by the same method as in the first example. 

[Seventh Embodiment] 

5 A case will be described below wherein the second example of an adaptive Huffman encoding unit based 

on indices shown in Fig. 59 is used as the adaptive Huffman encoding unit 505 shown in Fig. 49. 

A Huffman encoder 531 Huffman-encodes one-dimensionally sorted quantized coefficients in units of 64 
coefficients (Y, u, and v components of an 8 x 8 block), and outputs encoded data, bit sizes, and a block end 
w signal indicating the division of a block. 

A counter 532 counts bit size signals, and transfers the count result, i.e., an index to a comparator .533. 
The comparator 533 compares the transferred index with a value of an index table 535 shown in Fig. 60. 
When the index value exceeds a table value, the comparator 533 supplies a signal to a counter 534. 

The output (stage number) from the counter 534 has an initial value of 1, and the counter 534 increments 
is an output value in response to an input signal. More specifically, the stage number is incremented by one. 

In the index table shown in Fig. 60, for an 8 x 8 block of Y components, the output (stage number) from 
the counter 534 is 1 up to index 3. the stage number becomes 2 from indices 4 to 8. the stage number becomes 
3 from indices 9 to 15. and thereafter, the stage number becomes 4 until the counters 532 and 534 are reset 
by the block end signal, and the 8 x 8 block ends. 
20 In order to expand data encoded by this encoding method, the adaptive Huffman decoding unit requests 

encoded data of stage number #1 to the segment controller 20. The segment controller 20 reads encoded data 
of the first stage from the compression memory 22 with reference to the content of the segment information 
table 21 and transfers the read data to the adaptive Huffman decoding unit 505. The adaptive Huffman de- 
coding unit 505 decodes the obtained encoded data, and outputs the next stage number to be requested with 
25 reference to the index table. Thereafter, the stage number request and decoding of obtained encoded data 
are repeated until the number of decoded quantized coeff icients becomes 64 (the number of pixels in an 8 x 
8 block) After the 64 quantized coefficients are decoded, the next 8x8 block is decoded. 

In the adaptive Huffman decoding unit 505 shown in Fig. 50 or 57, the bit rates are distributed to the re- 
spective stages on the basis of bit sizes. As compared to this method, when the method of this embodiment 
30 (Fig 59) is used, the hardware scale can be reduced due to a simple algorithm, and the system can be realized 
at low cost although precision is slightly impaired. In this method (Fig. 59). no EOS code is needed at the di- 
visions of stages in a single 8x8 block, and the encoded data amount can be reduced accordingly. 

[Modification of Fifth, Sixth, and Seventh Embodiments] 

M In the fifth, sixth, and seventh embodiments described above, the number of stages to which compressed 

data are distributed in the ADCT section 14 is 4, but is not particularly limited (e.g., 2, 3, 5, or 6 stages may 

be used). 

In the fifth embodiment, the target bit rate of the entire image is set to be 2.4 [bits/pixel], but .s not partic- 

40 ularly limited to this value. . 

In the fifth and sixth embodiments, the target bit rate of the first stage is set to be 1.5 [bits/pixel], and the 
threshold value shown in Fig. 52 is determined based on this bit rate. However, the present invention is not 
limited to this value, and any other values may be used. Encoded data of the second and subsequent stages 
are distributed to be equally divided to three stages. However, the present invention is not limited to this. For 
45 example, encoded data may be distributed to the second, third, and fourth stages at any ratio (e.g.. 3:2:1. 
5: 3: Land the like). - . . 

In the seventh embodiment, the index table as a reference for stage distnbution shown in Fig. 60 is used. 
However the table values are not limited to those shown in Fig. 60. 

In the fifth embodiment, when compressed data divided into multiple stages are stored in the compression 
so memory 22 divided into a plurality of segments, the stage is made ineffective in an order from a stage having 
a larger stage number (stage number #4) to a stage having a smaller stage number (stage number #1). How- 
ever, the present invention is not limited to this. For example, the stage to be made ineffective may be adap- 

tively selected. ,_, 

In the fifth embodiment described above, the segment information table shown in Fig. 54 is used. However, 
55 the present invention is not limited to this, and various modifications may be made within the spirit and scope 
of the invention. 
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[Modification of Fourth Embodiment] 

In the fourth embodiment described above, the present invention is utilized in communications However 
the present invention is not limited to this. For example, the present invention may be utilized in data amount 
compression to reduce the sizes of, e.g., image files or the memory amount of a copying machine. 

In both the encoding and decoding modes, the three FF sections for storing colors are used. However 
the number of FF sections is not particularly limited (e.g.. four, five, or a hundred FF sections may be used)' 
As the number of FF sections is increased, the number of colors which can be stored can be increased 

When the color of a pixel of interest does not coincide with any color data held in the FF sections color 
data (24 bits) is added after code data. ln this case, color data of m (m < 24) bits may be added, and in this 
case, the number of bits to be compared in the comparison section may also be m. In this case, although a 
reversible encoding method is disabled, since a high-frequency image (e.g.. a character image) created by a 
computer does not require many gradation levels, deterioration of image quality is not conspicuous, and a hiqh 
compression ratio can be achieved. 

Furthermore, pallet data may be added after code data in place of color data. In this case, although the 
compression ratio can be expected to be improved, a device for converting color data into pallet data is addi- 
tionally required. 

Upon combination of reversible compression (CG compression) and ADCT compression with multi-stage 
storage according to the present invention, a natural image read by an image scanner, and a low-frequency 
image such as a gradation image having a large number of colors can be ADCT-compressed, and other image 
portions can be CG-compressed, thereby improving the compression ratio without deteriorating image quality 

According to the present invention, when a pixel of interest has the same value as color data C. of the 
immediately preceding pixel, the shortest code 'V is output; when the pixel of interest has a value different 
from C, buthas the same value as color data Cj of a pixel which appears latest, the second shortest code '01' is 
output; when the pixel of interest has a value different from C, and C 2 but has the same value as color data 
C, of a pixel which appears latest, the third shortest code '001 • is output On the other hand, when the pixel 
of interest has a value different from C„ C 2 , and C 3 , an unused code '000' and color data at that time are output 
In this manner, a computer-created image can be reversibly encoded at a high compression ratio without caus- 
ing conspicuous deterioration of image quality. 

The memory amount required at that time is given by (depth of pixel data) x n. When the number n of color 
data - 3. and (depth of pixel data) = 24 bits like in the above embodiment a memory for storing color data 
need only have a memory amount as small as 72 bits. 

Complicated circuits such as a run identification circuit, a Huffman encoding circuit, and the like are not 
requ.red and input pixel data can be sequentially processed. Color data to be stored in a memory need not 
have additional information such as strict positional information, and upper t bits (f 21 depth of pixel data) need 
only be simply compared with upper f bits of a pixel of interest to output a comparison result. As can be apparent 
from F,gs. 28 (encoding) and 33 (decoding), a circuit can be realized by a simple arrangement using flip-flops 
and comparators. 3 ^ H 

As many apparently widely different embodiments of the present invention can be made without departing 
from the spint and scope thereof, it is to be understood that the invention is not limited to the specific embodi- 
ments thereof except as defined in the appended claims. 



Claims 
1 



An image processing method for processing image data in units of blocks each consisting of a plurality 
of pixels, comprising the steps of: . 

reversibly compressing a block which satisfies D (D is the compressed data amount obtained 
when the block is reversibly compressed, and t is a predetermined value); and 
irreversibly compressing a block which satisfies D > L. 

An image processing apparatus for processing image data in units of blocks each consisting of a plurality 
of pixels, comprising: * 

reversible compression means for reversibly compressing a block which satisfies D & L (D is the 
compressed data amount obtained when the block is reversibly compressed, and L is a predetermined 
value); and 

irreversible compression means for irreversibly compressing a block which satisfies D > L 
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The apparatus according to claim 2, wherein said reversible compression means comprises: 
sorting means for one-dimensionally sorting pixel data of the block; 
latch means for latching the pixel data output from said sorting means; 

first comparison means for comparing first pixel data latched by said latch means with second pixel 
data output from said sorting means after the first pixel data, and outputting a first comparison result; 

second comparison means for comparing pixel data held in advance in at least one holding means 
with the second pixel data, and outputting at least one second comparison result; 

updating means for, when the first comparison result indicates a non-coincidence, and the second 
comparison result indicates a coincidence, updating pixel data in the holding means which holds the pixel 
data coinciding with the second pixel data to the pixel data latched by said latch means, and for. when 
both the first and second comparison results indicate a non-coincidence, updating pixel data in the holding 
means which holds the oldest pixel data to the pixel data latched by said latch means; and 

output means for, when the first comparison result indicates a coincidence, outputting the first com- 
parison result, for, when the first comparison result indicates a non-coincidence, and the second compar- 
ison result indicates a coincidence, outputting the f irst comparison result, and the second comparison re- 
sult in an order named, and for. when both the first and second comparison results indicate a non-coin- 
cidence, outputting the first comparison result, the second comparison result, and the second pixel data 
in an order named. 

The apparatus according to claim 3, wherein the first comparison result is a 1-bit signal, and the second 
comparison result is a signal consisting of at least 1 bit 

The apparatus according to claim 3, wherein said reversible compression means further comprises: 

calculation means for calculating the compressed data amount D on the basis of the first and sec- 
ond comparison results; ■ • 

discrimination means for discriminating a relationship between the compressed data amount D ob- 
tained by said calculation means and the limit value L; and 

recovery means for. when a discrimination result of said discrimination means indicates D > L, re- 
storing the pixel data latched by said latch means and pixel data held in the holding means to values before 
the beginning of processing of a present block. 

The apparatus according to claim 5, wherein said calculation means includes: 

a first counter for obtaining a first count value by counting the number of times of non-coincidences 
indicated by the first comparison result; and 

a second counter for obtaining a second count value by counting the number of times of non-co- 
incidences simultaneously indicated by the first and second comparison results, and 

said calculation means calculates the compressed data amount D on the basis of the first and sec- 
ond count values. 

The apparatus according to claim 6, wherein the compressed data amount D is calculated by; 

D = mxn + RxP + TxQ 
where m x n is the number of pixels of the block. P is the first count value. Q is the second count value, 
R is the number of bits of the second comparison result, and T is the number of bits of the pixel data. 

The apparatus according to claim 5, wherein said discrimination means includes: 

a difference calculation unit for calculating a difference S (= L - D) between the limit value L and 
the compressed data amount D of a processed block; and 

an accumulation unit for, when the discrimination result in the present block to be processed indi- 
cates D ^ L, updating the limit value L with a sum (C + S) of a predetermined value C and the difference 
S obtained by said difference calculation unit. 

The apparatus according to clajm 2. wherein said irreversible compression means comprises: 
color conversion means for converting a color space of image data; 
rthogonal transform means for orthogonally transforming image data converted by said color con- 



ort 



version means; 

quantization means for quantizing transform coefficients output from said orthogonal transform 
means; and 

encoding means for encoding quantized data output from said quantization means. 
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10. The apparatus according to claim 9, wherein said encoding means distributes and outputs codes obtained 
by encoding the quantized data in accordance with spatial frequencies of the quantized data. 

11. An image processing method for expanding compressed data obtained by compressing image data in 
5 units of blocks each consisting of a plurality of pixels, comprising the steps of: 

expanding the compressed data by selecting one of reversible expansion processing and irrever- 
sible expansion processing on the basis of information indicating a compression method of the com- 
pressed data; and 

reproducing original image data by synthesizing image data expanded by the reversible expansion 
10 processing and image data expanded by the irreversible expansion processing. 

12. The method according to claim 11, wherein the reversible expansion processing includes: 

the first input step of inputting a first bit corresponding to a pixel of the compressed data; 

the second input step of inputting compression information consisting of at least 1 bit of a second 
1S bit and the following bits corresponding to the pixel when the first bit is 'I'; 

the exchange step of exchanging pixel data latched by latch means with pixel data held in at least 
one holding means corresponding to a predetermined value when the compression information has the 
predetermined value; 

the updating step of updating the pixel data held by said holding means to the pixel data latched 
20 by said latch means, and thereafter, updating pixel data to be latched by said latch means to pixel data 

following the compression information when the compression information is different from the predeter- 
mined value; and 

the output step of outputting pixel data latched by said latch means. 

2S 13. The method according to claim 11. wherein the irreversible compression processing includes: 
the decoding step of decoding the compressed data; 

the inverse quantization step of inversely quantizing quantized data decoded in the decoding step- 
the inverse orthogonal transform step of inversely orthogonally transforming orthogonal transform 
coefficients inversely quantized in the inverse quantization step; and 

30 , the COl ° r conversion ste P of converting a colorspace of image data output in the inverse orthogonal 

transform step. 

14. An image processing apparatus for expanding compressed data obtained by compressing image data in 
units of blocks each consisting of a plurality of pixels, comprising: 

3S reversible expansion means for expanding reversibly compressed data; 

irreversible expansion means for expanding irreversibly compressed data- 
selection means for selecting one of said reversible expansion means and said Irreversible expan- 
sion means on the basis of information indicating a compression method of the compressed data- and 
synthesizing means for reproducing original Image data by synthesizing image data expanded by 

m said reversible expansion means and image data expanded by said irreversible expansion means. 

15. An image processing method for reversibly compressing image data, comprising: 

the latch step of latching input pixel data; 

the f^st comparison step of comparing first pixel data latched in the latch step with second pixel 
data input after the first pixel data, and outputting a first comparison result; 

thesecondcomparisonstepofcomparingatleasttwodifferentfirstandsecondholdingdata which 
are held in advance, with the second pixel data, and outputting a second comparison resulf 

the updating step of updating the first holding data to the first pixel data when the second com- 
parison result indicates a coincidence between the first holding data and the second pixel data, and of 
updating the second holding data to the first holding data, and thereafter, updating the first holding data 
to the first p.xel data when the second comparison result indicates a coincidence between the second 
holding data and the second pixel data or when both the first and second comparison results indicate a 
non-coincidence; and 

the output step of outputting a first code when the first comparison result indicates a coincidence 
of outputting a second code when the second comparison result indicates a coincidence between thef irst 
holding data and the second pixel data, of outputting a third code when the second comparison result 
indicates a coincidence between the second holding data and the second pixel data, and of outputting a 
fourth code and the second pixel data in an order named when both the comparison results indicate a 
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non-coincidence. 

16. The method according to claim 1 5. wherein the first code is 1 -bit data *1 \ the second code is 2-bit data 'OV , 
the third code is.3-bit data '001\ and the fourth code is 3-bit data *000\ 

17. An image processing apparatus for reversibly compressing image data, comprising: 

first holding means for holding input pixel data; 

second holding means for holding in advance at least two different first and second holding data; 

first comparison means for comparing first pixel data held by said first holding means with second 
pixel data input after the first pixel data, and outputting a first comparison result; 

second comparison means for comparing the first and second holding data held by said second 
holding means with the second pixel data, and outputting a second comparison result; 

updating means for, when the second comparison result indicates a coincidence between the first 
holding data and the second pixel data, updating the first holding data to the first pixel data, and for, when 
the second comparison result indicates a coincidence between the second holding data and the second 
pixel data or when both the first and second comparison results indicate a non-coincidence, updating the 
second holding data to the first holding data, and thereafter, updating the first holding data to the first 
pixel data; and 

output means for outputting a first code when the first comparison result indicates a coincidence, 
for outputting a second code when the second comparison result indicates a coincidence between the 
first holding data and the second pixel data, for outputting a third code when the second comparison result 
indicates a coincidence between the second holding data and the second pixel data, and for outputting 
a fourth code and the second pixel data in an order named when both the first and second comparison 
results indicate a non-coincidence. 

18. The apparatus according to claim 17, wherein the first code is 1-bit data '1\ the second code is 2-bit 
data 'OV, the third code is 3-bit data '001', and the fourth code is 3- bit data '000\ 

19. An image processing method for reproducing image data by expanding reversibly compressed data, com- 
prising: 

the output step of outputting one of at least three different pixel data stored in holding means or 
pixel data included in the reversibly compressed data in accordance with a priority order and 3-bit data 
of first to third bits of the input reversibly compressed data; and 

the updating step of updating the pixel data held by said holding means and the priority order in 
accordance with the priority order and the 3-bit data. 

20. An image processing apparatus for reproducing image data by expanding reversibly compressed data, 
comprising: 

holding means for holding in advance at least three different pixel data; 

storage means for storing a priority order of the pixel data held by said holding means; 

output means for outputting one of the pixel data stored in said holding means or pixel data included 
in the reversibly compressed data in accordance with the priority order and 3-bit data of first to third bits 
of the input reversibly compressed data; and 

updating means for updating the pixel data held by said holding means and the priority order in 
accordance with the priority order and the 3-bit data. 

21. The apparatus according to claim 20, wherein said output means outputs: 

pixel data having the highest priority when the first bit of the reversibly compressed data is T; 
pixel data having the second highest priority when the first and second bits of the reversibly com- 
pressed data are '01'; 

pixel data having the third highest priority when the first to third bits of the reversibly compressed 
data are '001'; and 

pixel data starting from a fourth bit of the reversibly compressed data when the first to third bits 
of the reversibly compressed data are '000'. 

22. The apparatus according to claim 20, wherein said updating means exchanges the priority order of the 
pixel data currently having the highest priority and the pixel data currently having the second highest pri- 
ority when the f irst and second bits of the reversibly compressed data are '01', 

updates the priority order of the pixel data currently having the highest priority to the second high- 
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est priority, the priority order of the pixel data currently having the second highest priority to the third 
highest priority, and the priority order of the pixel data currently having the third highest priority to the 
highest priority when the first to third bits of the reversibly compressed data are '001*. and 

updates the pixel data currently having the third highest priority to pixel data starting from a fourth 
5 bit of the reversibly compressed data, the priority order of the pixel data currently having the highest pri- 

ority to the second highest priority, the priority order of the pixel data currently having the second highest 
priority to the third highest priority, and the priority order of the pixel data currently having the third highest 
priority to the highest priority when the first to third bits of the reversibly compressed data are '000*. 

10 23. An image processing method for processing image data including pixel type information in units of blocks 
each consisting of m x n pixels, comprising: 

the analysis step of outputting first block information according to first pixel type Information and 
second block information according to second pixel type information in units of blocks; 

the replacing step of replacing a pixel having the first pixel type information with first pixel data, 
15 and replacing a pixel having the second pixel type information and the same value as the first pixel data 

with second pixel data; 

the reversible compression step of reversibly compressing the pixel data replaced in the replacing 
step in accordance with the first block information and the second block information, and outputting re- 
versibly compressed data and an area discrimination result; 
20 the interpolation step of interpolating pixels according to the pixel type information and the area 

discrimination result to pixel data according to other pixels in a block; 

the irreversible compression step of irreversibly compressing the block interpolated in the inter- 
polation step in accordance with the first block information and the area discrimination result; 

the block information output step of outputting third block information in accordance with the seo- 

25 ond block information and the area discrimination result; and 

the holding step of holding the reversibly compressed data output in the reversible compression 
step, and outputting the reversibly compressed data in accordance with the third block information. 

An image processing apparatus for processing image data including pixel type information in units of 
blocks each consisting of m x n pixels, comprising: 

analysis means for outputting first block information according to first pixel type information and 
second block information according to second pixel type information in units of blocks; 

replacing means for replacing a pixel having the first pixel type information with first pixel data, 
and replacing a pixel having the second pixel type information and the same value as the first pixel data 
with second pixel data; 

reversible compression means for reversibly compressing the pixel data replaced by said replacing 
means in accordance with the first block information and the second block information, and outputting 
reversibly compressed data and an area discrimination result; 

interpolation means for interpolating pixels according to the pixel type information and the area dis- 
crimination result to pixel data according to other pixels in a block; 

irreversible compression means for irreversibly compressing the block interpolated by said inter- 
polation means in accordance with the first block information and the area discrimination result; 

block information output means for outputting third block information in accordance with the second 
block information and the area discrimination result; and 

holding means for holding the reversibly compressed data output from said reversible compression 
means, and outputting the reversibly. compressed data in accordance with the third block information. 

The apparatus according to claim 24, wherein the first pixel type information indicates a natural image 
pixel, and the second pixel type information indicates a pixel other than a natural image. 

The apparatus according to claim 25, wherein the first block information indicates the presence/absence 
of a pixel having the first pixel type information in the block, and 

the second block information indicates the presence/absence of a pixel having the second pixel 
type information in the block. 

The apparatus according to claim 25, wherein when the first block information and the second block in- 
formation indicate a block consisting of only pixels other than a natural image, said reversible compression 
means calculates a compressed data amount D to be obtained upon reversible compression of the block, 
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and outputs an area discrimination result indicating a first area and reversibly compressed data if D ^ L 
(limit value), or outputs only an area discrimination result indicating a second area ifD = mxnorD>L; 

when the first block information and the second block information indicate a block including both 
natural image pixels and pixels other than the natural image, said reversible compression means calcu- 
lates the compressed data amount D to be obtained upon reversible compression of the block, and outputs 
an area discrimination result indicating the first area and reversibly compressed data if D S L, or outputs 
only an area discrimination result indicating the second area if D > L; and 

when the first block information and the second block information indicate a block consisting of 
only natural image pixels, said reversible compression means outputs only an area discrimination result 
indicating the second area. 

28. The apparatus according to claim 27, wherein said reversible compression means comprises: 

a first holding unit for holding input pixel data; 

a second holding unit for holding at least two different first and second holding data; 

a first comparison unit for comparing first pixel data held by said first holding unit with second pixel 
data input after the first pixel data, and outputting a first comparison result; 

a second comparison unit for comparing the first and second holding data held by said second hold- 
ing unit with the second pixel data, and outputting a second comparison result; 

an updating unit for, when the second comparison result indicates a coincidence between the first 
holding data and the second pixel data, updating the first holding data to the first pixel data, and for, when 
the second comparison result indicates a coincidence between the second holding data and the second 
pixel data or when both the first and second comparison results indicate a non-coincidence, updating the 
second holding data to the first holding data, and thereafter, updating the first holding data to the first 
pixel data; and 

an output unit for outputting a first code when the first comparison result indicates a coincidence, 
for outputting a second code when the second comparison result indicates a coincidence between the 
first holding data and the second pixel data, for outputting a third code when the second comparison result 
indicates a coincidence between the second holding data and the second pixel data, and for outputting 
a fourth code and the second pixel data in an order named when both the first and second comparison 
results indicate a non-coincidence. 

29. The apparatus according to claim 28. wherein the first code is 1-bit data T, the second code is 2-bit 
data '01\ the third code is 3-bit data '001 \ and the fourth code is 3-bit data '000*. 

30. The apparatus according to claim 27, wherein when the area discrimination result indicates the first area, 
said interpolation means interpolates pixels other than the natural image indicated by the pixel type in- 
formation. 

31. The apparatus according to claim 27, wherein said irreversible compression means irreversibly compress- 
es a block corresponding to the first block information indicating the presence of the natural image pixel, 
or a block corresponding to the area discrimination information indicating the second area. 

32. The apparatus according to claim 31, wherein said irreversible compression means comprises: 

a color conversion unit for converting a color space of image data; 

an orthogonal transform unit for orthogonally transforming image data converted by said color con- 
version unit; 

a quantization unit for quantizing transform coefficients output from said orthogonal transform unit; 

and 

an encoding unit for encoding quantized data output from said quantization unit. 

33. The apparatus according to claim 32, wherein said encoding unit distributes and outputs codes obtained 
by encoding the quantized data in accordance with spatial frequencies of the quantized data. 

34. The apparatus according to claim 27, wherein the third block information is 1-bit information which 
is T when the second block information indicates that a block includes a pixel other than the natural im- 
age, and the area discrimination result indicates the first area. 

35. The apparatus according to claim 34, wherein said holding means outputs held reversibly compressed 
data when the third block information is "1\ 
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36. An image processing method for expanding compressed data obtained by compressing image data in 
units of blocks each consisting of m x h pixels, comprising the steps of: 

irreversibly expanding the compressed data when method information indicating a compression 
method in units of blocks indicates irreversible compression; 
5 irreversibly expanding a pixel corresponding to pixel type information, obtained by analyzing the 

compressed data, indicating a predetermined pixel type, and reversibly expanding a pixel corresponding 
to the pixel type information indicating a pixel type other than the predetermined pixel type when the 
method information indicates reversible compression; and 

reproducing original image data by synthesizing reversibly expanded image data and irreversibly 
10 expanded image data. 

37. An image processing apparatus for expanding compressed data obtained by compressing image data in 
units of blocks each consisting of m x n pixels, comprising: 

irreversible expansion means for irreversibly expanding the compressed data; 
15 reversible expansion means for reversibly expanding the compressed data, and outputting pixel 

data and pixel type information; and 

selection means for selecting one of the output from said reversible expansion means and the out- 
put from said irreversible expansion means in accordance with method information indicating a compres- 
sion method in units of blocks, and the pixel type information, 
20 wherein original image data is reproduced by synthesizing the pixel data expanded by said rever- 

sible expansion means and image data expanded by said irreversible expansion means. 

38. The apparatus according to claim 37, wherein said irreversible expansion means comprises: 

decoding means for decoding the compressed data; 
25 inverse quantization means for inversely quantizing quantized data decoded by said decoding 

means; 

inverse orthogonal transform means for inversely orthogonally transforming orthogonal transform 
coefficients inversely quantized by said inverse quantization means; and 

color conversion means for converting a color space of image data output from said inverse ortho- 
30 gonal transform means. 

39. The apparatus according to claim 37, wherein said reversible expansion means comprises: 

a latch unit for latching predetermined pixel data; 

a holding unit for holding in advance at least three different holding data; 
35 a storage unit for storing updating information of the holding data held by said holding unit 

an updating unit for, when 1-bit data of a first bit of the compressed data is '1 V and 2-bit data of 
second and third bits is other than '11 \ exchanging the pixel data latched by said latch unit with holding 
data corresponding to the 2-bit data, and for, when the 1-bit data is '1\ and the 2-bit data is '11\ updating 
holding data indicated by the updating information to the pixel data latched by said latch unit, and there- 
^ after updating the pixel data latched by said latch unit to pixel data of a fourth bit and the following bits 

of the compressed data; and 

an output unit for outputting area information accordance with 3-bit data of the first to third bits of 
the compressed data, and outputting the pixel data latched by said latch unit. 

^ 40. The apparatus according to claim 39, wherein said output unit outputs area information having the same 
value as a value of an immediately preceding pixel when the 1-bit data is *0\ outputs area information 
indicating "area 1° when the 1-bit data is T and the 2-bit data is other than '11', and outputs pixel type 
information indicating "area 2" if pixel data starting from the fourth bit of the compressed data has a pre- 
determined value or pixel type information indicating "area 1" if the pixel data has a value other than the 
predetermined value when the 3-bit data is '111'. 

41. The apparatus according to claim 40. wherein when the method information indicates reversible compres- 
sion, and the pixel type information indicates "area 1", said selection means selects the output from said 
reversible expansion means; otherwise, said selection means selects the output from said irreversible 
expansion means. 

42. A method of reversibly compressing image data by run length coding, wherein the image data is divided 
into smaller blocks of pixels, the pixels of a block are ordered in a sequence to systematically cover the 
area of the block, and run lengths are encoded along said sequence of pixels. 

40 
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A method of image compression wherein the image is divided into blocks and reversible and irreversible 
types of compression process are applied to different blocks, depending on the degree of compression 
available by the reversible process. 
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